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IV 


IMPORTANT  SYMBOLS  AND  NOTATION 


In  the  text  the  following  notation  will  be  used  to  characterize  the  ordinary  renewal  pro- 
cess {Xi^i  = 1,2,...}  and  the  corresponding  ordinary  renewal  counting  process  > 

0}  under  consideration: 

• /(•)  and  F(-)  to  denote  respectively  the  probability  density  function  and  the  distri- 
bution function  of  the  inter-renewal  times 

• fo  denote  the  n-fold  convolution  of /(•)  with  itself. 

• to  denote  the  integral  of 

• i-L  to  denote  the  mean  inter-renewal  time 

• rn{')  and  Af(-)  to  denote  respectively  the  renewal  density  and  the  renewal  function 

• and  to  denote  respectively  the  second  amd  third  raw  moments  of  the  inter- 
renewal times 


• B[t)  to  denote  the  backward  recurrence  time  measured  from  some  time  t 

• V{t)  to  denote  the  forward  recurrence  time  measured  from  some  time  t 


• i — T 2,  • • • to  denote  the  waiting  time  of  the  j-th  renewal 


1 A basic  assumption  for  this  work  is  that  < cxj.  We  also  restrict  our  research 
to  inter-renewal  times  that  have  probability  density  functions. 

2 Throughout  this  work  the  time  origin  is  not  counted  as  a renewal  epoch.  Similar 
works  by  other  authors  count  the  origin  as  a renewal  epoch  and  therefore  their  results  are 
not  immediately  comparable  with  the  results  of  this  work. 
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Renewal  theory  has  been  used  extensively  to  solve  a large  number  of  problems  in  science 
and  engineering.  Areas  of  application  in  Operations  Research  have  been  inventory  theory, 
reliability  theory,  queueing  theory,  etc.  H.  D.  Sivazlian  has  proposed  a unified  methodol- 
ogy based  on  multiple  integrals  to  study  various  problems  in  renewal  theory.  Using  this 
methodology  we  derive  new  results  in  the  study  of  the  backward  and  forward  recurrence 
times,  the  probability  law  of  the  renewal  counting  process  and  the  distribution  of  the  order 
statistics  generated  by  the  waiting  times  of  a renewal  process.  The  notion  of  the  extended 
compound  renewal  process  is  introduced.  A Volterra  ty])e  integral  equation  for  the  char- 
acteristic function  of  this  process  is  used  to  derive  the  moments  of  this  process.  Several 
applications  in  infinite  server  queues  are  considered.  Moreover,  the  concept  of  the  extended 
compound  point  process  is  introduced  for  which  expressions  for  the  moments  are  derived 
and  applications  in  queueing  theory  are  investigated.  Finally,  some  suggestions  for  future 
research  are  made. 
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CHAPTER  1 


INTRODUCTION 


1. 1 Preview 

An  ordinary  renewal  process  is  a collection  of  independently  and  identically  distributed 
random  variables  usually  representing  the  time  intervals  between  occurrences  of  events.  A 
renewal  counting  process  is  a.  stochastic  process  that  registers  the  number  of  events. 


As  the  title  of  this  dissertation  -“Integral  Techniques  in  the  Study  of  the  Ordinary 
Renewal  Process  and  its  Extensions”—  suggests,  the  purpose  of  this  work  is  to  use  known 
integral  techniques  to  obtain  novel  results  for  the  renewal  process  and  its  extensions,  namely 


the  extended  compound  renewal  process  and  the  extended  compound  process.  In  the  in- 
troduction we  provide  the  reader  with  basic  definitions,  a brief  historical  review  of  renewal 


theory,  a brief  discussion  of  the  elementary  problems  in  this  area,  the  existing  methodologies 
and  with  a number  of  applications  of  renewal  theory  in  operations  research.  Additionally, 


we  desciibe  the  problems  of  the  general  probability  law  of  the  renewal  counting  process. 


the  order  statistics  of  the 


waiting  times  of  the  ordinary 


renewal  process  and 


the  filtered 


and  extended  compound  renewal  process.  Finally,  we  provide  a summary  of  the  new  results 
obtained  and  an  outline  of  the  dissertation. 


1.2  The  Renewal  Process 


According  to  Smith[40]  “by  the  term  renewal  process  is  meant  a sequence  = 

1,  2, . . .}  of  independent,  nonnegative,  identically  distributed  random  variables,  and  to  avoid 
triviality  we  suppose  the  A^  do  not  vanish  with  i^robability  one.  These  Xi  are  meant  to 
represent  the  lifetimes  of  the  articles  being  renewed”(p.  245)(see  Figure  1.1).  Later  the 
notion  of  renewal  process  was  extended  to  allow  the  distribution  of  Ai  (or  by  others  of 
Aq)  to  be  different  from  that  of  the  rest  of  the  A Us.  To  distinguish  these  cases,  the  former 
is  called  ordinary  r^enewal  process  while  the  latter  is  called  delayed,  or  modified  renewal 
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Figure  1.1.  A realization  of  a renewal  process 

process.  Throughout  this  chapter  the  term  renewal  process  refers  to  the  ordinary  renewal 
process.  As  the  definition  suggests  the  renewal  process  can  be  perceived  as  a generalization 
of  the  Poisson  process  in  which  the  secjiience  {Ai,  / = 1,2,...}  of  independent  identically 
distributed  random  variables  obeys  the  negative  exponential  distribution. 

1.3  Henewal  Theory 

The  origins  of  renewal  theory  -the  theory  concerned  with  the  study  of  renewal  processes- 
are  found  in  the  discussion  of  self-renewing  aggregates.  ^ Lotka’s  paper[29]  -published  in 
1939—  on  self  renewing  aggregates  contains  a.  list  of  74  papers  on  the  subject  of  renewal 
equation  and  its  applications.  The  oldest  paper  mentioned  is  one  by  Herbelot[20]  who 
encountered  the  renewal  equation  while  investigating  an  actuarial  problem.  Later  Feller[ll] 
became  the  first  to  formally  study  the  integral  equation  of  renewal  theory.  Skellam  and 
Shenton[39]  in  their  study  of  “distributions  associated  with  random  walk  and  recurrent 
events”(p.  64)  obtain  several  results  for  special  renewal  processes.  Smith[40]  provides  a 
thorough  review  of  renewal  theory.  Cox[9]  discusses  many  theoretical  and  applied  problems 

in  the  area.  Cohen[8],  Daley  and  Vere-Jones[10]  and  VVolff[42]  present  a more  modern 
approach  to  the  theory. 

As  we  already  mentioned,  actuarial  problems  have  been  historically  the  first  applications 
of  renewal  theory.  Population  analysis  and  industrial  replacement  problems  have  been  two 
other  areas  of  application  of  renewal  theory  in  its  early  stages.  More  recently,  renewal  theory 

has  found  applications  in  the  areas  of  astronomy,  astrophysics,  economics,  engineering, 
meteorology  and  physics. 


^The  English  translation  due  to  Lotka[29]  of  the  German  phrase  '‘sicli  erneiiernde  Gesamtheiten,”  used 
by  Swiss  actuaries. 
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Renewal  theory  has  found  a very  fruitlul  area  of  application  in  modeling  complex  systems 
in  reliability,  maintainability  and  availability.  Renewal  theory  has  been  used  for  example 
1)  to  define  the  operating  characteristics  of  maintenance  policies,  2)  to  solve  the  age  and 
block  replacement  problem,  3)  to  formulate  repair  problems  of  single  and  multi-units,  and 
4)  to  derive  optimum  inspection  and  maintenance  policies.  The  theory  has  also  been  ap- 
plied to  solve  problems  in  reliability  arising  from  shock  processes,  cumulative  damages  and 
redundancies. 

Other  areas  of  applications  in  operations  research  where  renewal  theory  has  been  utilized 
have  been  single  and  multi-commodity  inventory  systems,  queueing  systems,  maintenance 
and  replacement  systems.  More  recently  in  using  diffusion  approximation  to  solve  complex 
queueing  systems,  such  as  the  machine  repair  j)i‘oblem  with  standbys,  renewal  theory  has 
been  used  to  generate  the  infinitesimal  means  and  variances  to  the  diffusion  equation. 

1.4  Fundamentals  of  Renewal  Theory 


Related  to  the  renewal  process  (as  defined  previously)  is  the  renewal  counting  process^ 
> 0}  which  is  defined  to  be  the  counting  process  that  registers  the  number  of 
renewals  that  occurred  within  a time  interval  ((),/]  (see  Figure  1.2).  The  sum  Wk  = Xi  + 
X2  + . . . + X/j  is  called  the  waiting  time  of  the  k-t\\  renewal. 


The  least  information  one  would  like  to  know  is  the  expectation  of  the  number  of  renewals 
up  to  time  E[X ( / )]  which  is  called  the  renewal  junction  and  is  usually  denoted  by  M{t). 
Its  first  derivative  m(/)  plays  an  important  role  and  is  known  as  the  renewal  density.  The 
behavior  of  these  two  quantities  has  been  thoroughly  investigated. 


Next  arises  the  problem  of  determining  the  probability  distribution  of  the  number  of 

lenewals  up  to  a certain  time  epoch  / (i.e.  Pr{AT0  = ^^})«  This  has  been  well  investigated 
in  the  literature  and  appears  in  standaid  textbooks. 


Two  other  measures  related  to  the  renewal  process  are  the  backward  and  forward 


re- 


currence times.  The  backward  recurrence  time  also  known  as  the  current  life,  is  the  time 
elapsed  since  the  last  renewal.  The  forward,  recurrence  time  or  also  known  as  the  excess  life, 


Many  textbooks  defiiie  the  renewal  process  as  what  we  call  here  renewal  counting  process. 
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Figure  1.2.  A realization  of  a renewal  counting  process 


is  the  time  that  will  elapse  till  the  next  renewal.  The  sum  of  the  backward  and  forward 
recurrence  time  or  the  total  life  is  anotlier  measure  of  interest. 

Early  research  targeted  the  limiting  behavior  of  the  renewal  process  as  time  tends  to 
infinity.  This  work  obtains  several  results  on  distributions  invoking  the  backward  and 
forward  recurrence  times  and  their  sum  for  the  time  dependent  case. 

A renewal  counting  process  is  fully  characterized  by  its  general  probability  law,  that 
is,  the  joint  (mass)  distribution  function  of  the  number  of  renewals  at  distinct  time  epochs 

ti^t2^ . . . ,tn,  where  0 < /i  < /2  < • • • < In  {n  being  an  arbitrary  positive  integer).  We 
discuss  this  in  a subsequent  section. 


1.5  Applications  of  Renewal  Theory 


In  this  section  we  provide  some  applications  of  renewal  theory,  in  the  modeling  of  oper- 
ations reseaich  pioblems.  Since  part  of  this  work  is  concerned  with  backward  and  forward 
lecuiience  times,  we  motivate  our  discussion  empliasizing  applications  in  which  these  two 
recurrence  times  appear  as  important  variables  of  the  model. 
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Figure  1.3.  A realization  of  a periodic  review  inventory  system  operating  under  a general 
(s,S)  policy  with  fixed  inspection  periods 


1.5.1  Inventory  Theory 


A periodic  review  model.  Consider  a.  periodic  review  inventory  system  operating  under 
a general  (s^S  ) policy  with  fixed  inspection  periods.  VVe  assume  that  demands  between 
successive  periods  are  independent  and  identically  distributed  random  variables.  Moreover, 
let  us  assume  instantaneous  delivery  of  the  ordered  quantity.  Each  time  the  inventory 
level  X is  less  than  s we  place  an  order  of  (,S  — .t)  units  that  instantaneously  brings  the 
inventory  level  to  S.  Note  that  each  time  the  inventory  level  is  S\  the  system  is  in  a state 
identical  to  that  of  any  other  instance  in  which  the  inventory  was  *S  . These  points  (x  — S) 

aie  called  legeneration  points.  Let  Di^i  = 1,2,...  denote  the  demands  in  the  respective 

time  intervals  between  inspection  periods  after  a regeneration  point.  Clearly  the  D^’s  form 
a renewal  process  (see  Figure  1.3).  If  we  consider  the  moment  that  the  inventory  hits 

the  level  then  the  inventory  level  at  the  instance  of  the  next  inspection  is  the  forward 

lecuiience  time  of  the  renewal  process,  dhe  inventory  level  at  the  instance  of  the  previous 
inspection  is  the  backward  recurrence  time.  Knowing  the  distributions  of  the  backward  and 
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forward  recurrence  times  in  combination  with  the  appropriate  cost  functions  may  be  used 
to  determine  the  total  cost  function  and  the  parameters  that  optimize  it. 


This  model  is  a very  good  example  of  a renewal  theory  whose  parameter  does  not 
represent  time.  It  demonstrates  the  broader  scope  of  renewal  processes  and  the  fact  that 
they  are  not  restricted  to  model  systems  varying  over  time. 


A continuous  review  model  with  positive  lead  time.  Consider  a continuous  review  model, 
Demand  inter-arrival  times  form  a renewal  process.  The  demand  sizes  are  identically  and 
independently  distributed  random  variables  thus  forming  another  renewal  process.  The  in- 
ventory replenishment  policy  is,  whenever  the  inventory  level  falls  below  5 > 0,  a quantity 
is  ordered  to  bring  the  inventory  level  up  to  a positive  value  S > 0.  In  general,  the  quantity 
ordered  is  not  constant  and  is  dictated  by  the  demand  pattern.  It  is  always  greater  than 
or  equal  to  S — s.  The  quantity  by  which  it  exceeds  S — s is  the  forward  recurrence  time 
of  the  renewal  process  formed  by  the  demand  at  epoch  S — s.  The  orders  arrive  after  some 
constant  time  r.  Following  the  replenishment  of  an  order,  the  time  till  the  next  demand 
arrives  is  the  forward  recurrence  time  of  the  renewal  process  formed  by  the  inter- arrival 
times  at  epoch  r.  For  the  use  of  renewal  theory  in  modeling  inventory  systems  the  reader 
is  referred  to  Arrow  et  al.[l] 


1.5.2  Queueing  Theory 


A single  server  queue.  The  time  intervals  from  the  epoch  at  which  the  server  becomes 
busy  until  the  epoch  at  which  he  becomes  idle  are  known  as  the  busy  cycles.  Moreover,  we 
assume  that  the  service  times  are  independent  and  identically  distributed  random  variables 
denoted  by  = 1,2,....  Clearly  then  these  form  a renewal  process.  One  of  the  per- 
formance characteristics  of  a queueing  system  is  the  total  waiting  time  in  the  queue.  Let 
us  suppose  that  a customer  arrives  during  a busy  cycle  and  finds  in  customers  ahead  of 
him  waiting  in  the  queue  and  one  being  presently  served.  Then  he  has  to  wait  for  the  m 
customers  to  be  served  as  well  as  the  customer  in  service  to  complete  his  service.  The  time 
for  m customers  to  be  served  is  the  sum  of  m independently  and  identically  distributed 
random  variables  and  the  time  for  service  completion  is  the  forward  recurrence  time  of  the 
renewal  process. 


An  infinite  server  queue.  Consider  again  a queueing  system  with  customers  arriving 
again  according  to  a renewal  counting  process.  The  number  of  servers  is  now,  however, 
infinite.  A customer  that  arrives  always  finds  an  idle  server  and  enters  for  service  imme- 
diatelly.  This  system  can  be  modeled  and  studied  by  using  an  extension  of  the  renewal 
counting  process,  namely  the  extended  compound  renewal  process.  We  discuss  this  type  of 
applications  in  Chapter  5. 

1.5.3  Reliability  Theory 


Renewal  theory  has  found  some  interesting  applications  in  modeling  reliability  problems. 
We  describe  here  a simple  model  utilizing  renewal  theory.  Assume  a reliability  model  where 
the  component  of  interest  suffers  lailures  due  to  wear-out.  We  assume  that  the  initial 
‘‘strength”  of  this  component  is  A’o  (where  AT  is  an  integer  number).  Each  time  the 
component  suffers  a wear-out  its  strength  decreases  by  one.  The  time  intervals  between 
successive  wear-outs  are  assumed  to  be  independent  and  identically  distributed  random 
variables  and  thus  forming  a renewal  process. 


A frequent  task  of  reliability  models  is  to  find  the  remaining  life  of  a component  at 
an  arbitrary  time  epoch  ti  given  that  it  is  operating  at  this  time.  Let  T{ti)  denote  the 
remaining  life  of  the  component  given  it  has  survived  up  to  time  t\.  We  may  know  the 
number  of  wear-outs  U]  the  component  has  suffered.  Then  this  number  is  nothing  more 
than  the  number  of  renewals  at  time  /]  i.e.  iV(^i)  = The  time  till  the  next  wear-out 
is  the  forward  recurrence  time  V (/i).  The  remaining  (unused)  strength  is  AV  = AT  — ni. 
Then  the  time  to  failure  starting  from  time  is 


— 1'  ( ) + A rn  -j-1  + . . . + A /Vq 


If  we  do  not  know  the  number  ol  renewals  up  to  time  t\  then  the  remaining  strength  is 
an  integer  valued  random  variable  and  the  remaining  life  is  a compound  process. 

For  the  use  of  renewal  processes  in  reliability  theory  the  reader  is  referred  to  Barlow  et 
al.[2] 
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1.5.4  Group  Replacement 

Let  us  assume  that  we  operate  a large  number  of  identical  components  subject  to  failure 
and  we  consider  a group  replacement  policy.  Each  item  is  replaced  after  failure  in  the  time 
interval  (0,^i]  (where  time  counts  from  the  last  group  replacement).  Moreover,  all  items 
are  replaced  at  time  ti.  Then  the  age  of  the  components  that  are  being  replaced  at  time 
is  the  backward  recurrence  time. 


1.5.5  A Maintenance  Problem 


We  consider  work  to  be  processed  on  a single  processor  (or  machine)  subject  to  break- 
down and  repair.  Repair  is  initiated  as  soon  as  the  processor  breaks  down.  At  the  termi- 
nation of  repair,  the  processor  starts  its  functions  immediately.  Let  {X^-,  i = 1,2,...}  be 
the  sequence  of  uptimes  and  {T^-,  i = 1,2,...}  the  sequence  of  downtimes.  The  time  to 
complete  a piece  of  work  of  size  Q is  a random  variable  and  can  be  described  by  means  of 
an  extended  compound  renewal  process. 

1.5.6  Traffic  Control 


In  general,  traffic  problems  can  be  modeled  by  renewal  processes.  We  present  a simple 


case. 

Assume  that  the  time  intervals  between  passages  of  cars  at  an  intersection  are  indepen- 
dent and  identically  distributed  randojii  variables.  If  an  observer  at  the  intersection  starts 


observation  at  an  arbitrary  instance  in  time,  then  the  time  until  the  next  car  passes  is  the 


forward  recurrence  time, 
time. 


The  tijne  since  the  last  car 


passed  is  the  backward  recurrence 


1.5.7  Life  Testing  of  Components 


Consider  the  case  when  someone  wants  to  test  the  life  of  a certain  component.  He  may 
do  so  by  operating  one  component  until  it  fails  and  immediately  replacing  it  by  another 
identical  component  and  operating  it  until  it  fails.  The  collection  of  the  successive  times 
to  failure  (assumed  identically  and  independently  distributed)  form  a renewal  process.  The 
number  of  failed  components  iij)  to  time  / forms  a renewal  counting  process.  If  the  test 
stops  at  time  C then  the  age  of  the  component  presently  tested  is  the  backward  recurrence 
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time  while  its  remaining  life  is  the  forward  recurrence  time.  An  interesting  non-intuitive 
result  appears  in  renewal  theory  related  to  life  testing  ])roblems.  VVe  discuss  the  so-called 
‘‘inspection  paradox’'  in  the  next  subsection. 


1.5.8  The  Inspection  Paradox 


Let  us  assume  that  life  tests  are  performed  as  follows.  The  items  are  tested  one  at 
a time  by  a device  that  automatically  and  spontaneously  replaces  a failed  item  by  a new 
one.  Moreover,  the  device  records  the  time  since  the  last  failure.  An  observer  arrives  at 
certain  time  epochs.  He,  immediately,  records  the  age  of  the  component  being  tested  and 
waits  until  it  fails.  The  life  of  the  component  tested  is  the  sum  of  the  recorded  age  at  the 
moment  of  his  arrival  plus  the  observed  time  to  failure,  i.e.  the  sum  of  the  backward  and 
forward  recurrence  times.  He  leaves  and  returns  several  times  to  repeat  his  observation  in 
a similar  fashion.  Intuitively  be  believes  that  the  average  of  his  observations  can  be  a good 
estimate  for  the  mean  time  to  failure  of  the  items.  But,  the  fact  is  that  his  estimate  is 
very  biased.  In  fact,  it  will  tend  to  l)e  gi*eater  than  the  actual  value  of  the  mean  time  to 
failure.  The  only  explanation  to  this  is  that  the  observer  is  more  likely  to  observe  larger 
inter-renewal  times.  Actually  in  Hey  man  and  Sobel[21],  by  assuming  in  the  limiting  case 
that  the  likelihood  that  the  observer  will  measure  an  inter-renewal  time  is  proportional  to 
the  length  of  this  time,  one  recovers  the  desired  result.  This  phenomenon  has  been  known 
in  the  literature  as  the  inspection  paradox.  It  has  been  investigated  for  the  limiting  case  as 
time  tends  to  infinity.  It  has  also  been  investigated  for  the  limiting  and  time  dependent  case 
for  negative  exponentially  distributed  times  to  failure  (in  which  case  they  form  a Poisson 
process).  In  this  work  we  show  that  the  inspection  paradox  exists  for  the  time  dependent 
case  and  an  arbitrary  distribution  of  inter- renewal  times  with  probability  density  function 
and  finite  mean. 


1.6  Methodology  in  the  Study  of  Renewal  Processes 


Most  of  the  past  research  done  in  the  area  of  renewal  processes  has  utilized  the  renewal 
equation,  as  a means  to  derive  the  desired  results.  The  renewal  equation,  as  defined  by 
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Feller  [11],  is  an  integral  equation  of  the  form 


A(t)  = a{t)  + / A(t  — u)dF('u) 
or  using  * to  denote  the  standard  convolution  operation: 


A(t)  = a(t)  + A(t)  * F(t) 


Here  the  prescribed  (or  known)  functions  are  a{t)  and  the  distribution  function  F(t)^  while 
the  undetermined  (or  unknown)  quantity  is  A(t).  The  renewal  equation  is  readily  solved, 
in  principle,  using  various  methods,  one  of  which  is  the  well  known  method  of  Laplace 
transforms  (provided  that  the  functions  in  the  equation  are  transformable).  The  derivation 
ol  a renewal  equation  in  most  cases  has  relied  on  event  arguments,  thus  restricting  the 
scope  of  the  methodology.  B.  D.  Sivazlian  has  more  recently  presented  a more  elegant  and 
unified  methodology  in  approaching  the  problems  of  renewal  theory  (see  Sivazlian[37j)  using 
multiple  integrals.  This  methodology  is  l)ased  on  the  following  theorem: 


Theorem  1 Define  for  i > 0,  the  function  g(t)  t C (i.e.  continuous)  and  the  function  (pi{t)  G 
K (i.e.  with  at  most  a finite  number  of  points  of  discontinuity  in  every  finite  interval  and 
such  that  the  integral  /J  \(pi{u)\d'u  has  a finite  value  for  every  / > Oj,  z = 1,  2, . . . , n where 
n is  a positive  integer.  Then 


<y(/l  + /2  + • • * + fn)0l(t}  )<p2(f‘2)  • • ' <l>n{in)(l'fl(lf2  ‘ ' dt 


n 





fj(  ^O[01  ( U ) * 02 ( U )*•••*  0n(  u)]dli 


where  the  integrand  of  the  right  hand  single  integral  is  a.  function  of  class  Af. 


Here  the  notation  * refers  to  the  usual  convolution  operation. 

In  this  methodology  we  identify  the  region  of  integration  (i.e.  the  region  corresponding 
to  the  desirable  event)  over  which  we  have  to  integrate  the  joint  probability  density  function 
of  an  arbitrary  number  of  renewals  and  then  ap])ly  this  theorem  to  produce  our  results. 

The  fundamental  advantage  of  this  methodology  is  that  we  can  use  one  methodology  to 
solve  the  majority  of  problems  arising  in  renewal  theory,  and  to  tackle  presently  unsolved 
problems.  A brief  proof  of  the  theorem  in  its  more  general  form  is  given  in  the  Appendix. 
For  a complete  treatment  of  the  ])roblem  see  Sivazlian[35]. 
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1.7  The  General  Probability  Law  of  the  Renewal  Counting  Process 

Let  = 1,2,...,  be  the  sequence  of  inter-renewal  times  in  an  ordinary  renewal 

process,  assumed  to  be  independent  and  identically  distributed  random  variables  with  prob- 
ability density  function  /(a’),0  < x < oo,  and  distribution  function  F{x).  Let  > 0} 

be  the  total  number  of  renewals  in  [0,/]  where  Pr{A^(0)  = 0}  = 1 Consider  distinct  time 
epochs  - where  0 < < /-2  < • • • < and  m is  an  arbitrary  positive  integer. 

The  general  probability  law  of  the  renewal  counting  process  may  be  defined  by 

Pr{A^(/l)  UuN{t2)  = 7^2,...,77(/„^)  = llm} 


where  0 < 7^l  < 112  ^ • • • < for  arbitrary  in.  Other  representations  of  the  probability 
law  of  the  process,  such  as  the  joint  characteristic  function,  may  be  appropriate  depending 
on  the  nature  of  the  intended  results.  This  problem,  despite  its  early  inception  and  its  many 
usages,  has  been  considered  so  far  to  be  too  difficult  a task  to  tackle  and  thus  remained 
unsolved.  The  only  special  case  of  a renewal  counting  process  vvdiose  general  probability 
law  has  been  derived  is  the  Poisson  process. 

Sivazlian[36]  has  recently  derived  the  joint  distribution  of  the  number  of  renewals  at  two 
time  epochs;  i.e.,  Pr{A(^i)  = 77i,iV(/2)  = 712}.  In  the  present  work  the  joint  distribution 
of  the  number  of  renewals  at  three  time  epochs;  i.e.,  Pr{A^(/i)  = ni,N{t2)  = ri2,N{ts)  - 
7r3}  is  determined.  This  joint  distribution  function  without  loss  of  generality  defines  the 
probability  law  of  the  process. 

In  the  case  of  the  Poisson  process  the  joint  probability  law  of  the  renewal  increments 
shows  that  they  are  independently  distributed;  i.e.. 


Pr{A'(/2)  — N{ti)  — 7?-i,  A^(/3)  — A^(/2)  = ^2}  = 

Pr{A'(/2)  - A'(/i)  = n,}¥v{N(ts)  ~ N(t2)  = 112} 

The  covariance  function  of  the  renewal  increments,  which  is  presented  in  this  work, 
enables  us  to  characterize  the  renewal  pi*ocess  with  respect  to  its  increments. 

^Several  textbooks  and  papers  assume  that  Pr{A'(0)  = 1}  = 1. 
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1.8  The  Order  Statistics  of  the  Renewal  Process 

Consider  a renewal  process  { A^,  i — 1,2,...}.  Then  we  define  the  waiting  times  W{^  i — 
1,2,...,  of  the  renewals  as  \Vi  — IT2  = A]  + A^2,  etc.  Given  the  number  of  n (n  > 
1)  renewals  up  to  time  /,  the  order  statistics  is  the  ordered  set  of  the  waiting  times 
{ITi,  14^2, . . . , Wn}-  A problem  to  be  investigated  is  the  general  probability  law  of  the  order 
statistics;  i.e.. 


Pr{Hfi  < a’l,  W2  < u?2, . . . , Wn  < 'Wn\N(t)  = n] 


for  arbitrary  n.  Related  problems  are  the  distribution  of  the  range  i.e.  Wn  - ITi,  the 
distribution  of  the  first  order  statistic  (the  miiiimum),  of  the  k-th  order  statistic  (1  < A:  < ?i), 
of  the  n-th  order  statistic  (the  maximum)  and  the  joint  probability  law  of  their  possible 
combinations.  This  problem  has  been  investigated  for  the  case  when  inter-  renewal  times 
obey  the  negative  exponential  distribution,  the  renewal  counting  process  being  the  well- 
known  Poisson  process.  For  this  case  the  probability  density  function  of  the  order  statistics 
is  found  to  be 


Pr{u;i  < Wi  < wi  du’i,  1U2  < IT2  ^ ^^'’2  + diU2^ . . . , Wn  < ^ + diUn\N(t)  = n}  = 


n: 


= — diui  dw2  . . . dw 

tn 


n 


(1.1) 


where  0 < lUi  < W2  < ...  < lUn-  T his  is  nothing  more  than  the  probability  density  function 
of  the  order  statistics  of  the  uniform  distribution. 


This  result  finds  application  in  the  treatment  of  many  problems  including  the  study 
of  the  filtered  Poisson  process(see  Parzen[.3 1] ) and  networks  of  infinite  server  queues  (see 
Harrison  and  Lemoine[19] ).  The  distribution  of  the  order  statistics  may  be  helpful  in  the 
study  of  similar  problems  in  renewal  theory.  The  expression  corresponding  to  (1.1)  when 
the  process  is  an  ordinary  renewal  counting  process  will  be  obtained  in  the  sequel. 

1.9  Extensions  of  the  Renewal  Process 


We  first  define  the  filtered  Poisson  process: 
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A stochastic  process  {A(/),/  > 0}  is  said  to  be  a fUlered  Poisson  process  if  it  can  be 


represented  by 


N{t) 
m = l 


(1.2) 


where 


1.  {N{t)^t  > 0}  is  a Poisson  process  with  intensity  A; 

2.  {Ym-,  m = 1, 2, . . .}  is  a sequence  of  independently  and  identically  distributed  random 
variables,  independent  of  {N{t),t  > 0}; 

3.  {Wjn,  m — 1, 2, ...}  is  a sequence  of  waiting  times  of  the  Poisson  process  {A^(/),  / > 0}; 

4.  in(/,  .T,  y)  is  a real  valued  function  of  three  variables  and  is  called  the  response  function. 

Parzen[31]  gives  the  following  j)hysical  interpretation  for  the  filtered  Poisson  process: 

if  Wm  represents  the  time  at  which  an  event  took  place,  then  represents 
the  amplitude  of  a signal  associated  with  the  event,  w[t^  M'm,  1^)  represents  the 
value  at  time  t of  a signal  of  magnitude  originating  at  time  Wm>,  and  X{t) 
represents  the  value  at  time  / of  the  sum  of  the  signals  arising  from  the  events 
occurring  in  the  interval  (0,  / ]. 


For  more  information  to  the  theory  of  filtered  Poisson  processes  the  reader  is  referred 
to  Blanc-Lapierre  and  Fortet[3],  Pa.j‘zen[31]  and  Karlin  and  Taylor[25]. 

A natural  extension  of  the  concept  of  the  filtered  Poisson  process  is  the  filtered  renewal 
process.  The  filtered  renewal  process  is  defined  similarly  to  the  filtered  Poisson  process,  only 
now  {N (t)  ,<>()}  is  a renewal  counting  process. 

A stochastic  process  related  to  the  filtered  renewal  process  is  the  cumulative  process 
defined  as  follows. 

Let  {(AT,  IT ),  k = 1 , 2, . . .}  be  a sequence  of  independent  and  identically  distributed 
bivariate  random  variables  with  Joint  distribution  function  d)(x^y).  Suppose,  moreover, 
that  the  A/^’s  are  strictly  positive  thus  forining  a renewal  process  and  that  > 0}  is 

the  renewal  counting  process  related  to  them.  Then 

zit)=  E yj 
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is  a cumulative  process. 

Clearly,  if  in  addition  we  assume  that  the  X^’’s  are  independently  distributed  of  the 
Y/j’s,  the  cumulative  process  is  a special  case  of  the  filtered  renewal  process  with  response 


function 


iv(t,Wk,Yk)  = Yk 


Cumulative  processes  have  found  many  applications  in  operations  research  problems 
such  as  inventory  and  reliability  models.  Recently,  Roginsky[34]  has  presented  some  inter- 
esting asymptotic  results  on  renewal  and  cumulative  processes. 

The  notion  of  the  filtered  Poisson  process  can  be  extended  if  we  let 

N{t) 

X(t)  = 

m = l 

= li(/,  H'l ) + V2(/,  W2)  + . . . 5'/v(()(i,  (1-3) 


where 

m {l',^Ym)',t  > ITm}  is  now  a seciuence  of  stochastic  processes  (see  Parzen[31]).  We 
call  similar  process  where  the  underlying  point  process  is  a renewal  process,  an  extended 
compound  renewal  process. 

The  primary  reason  for  being  unable  to  extend  the  theory  of  the  filtered  Poisson  process 
has  been  the  unavailability  of  mathematical  techniques  to  handle  the  complex  multiple 
integral  expressions  that  arise  in  related  problems.  For  an  extensive  introductory  discussion 
on  the  filtered  renewal  process,  the  reader  is  referred  to  Sivazlian[37]. 

I.IQ  Objectives  and  New  Results 

We  make  use  of  a unifying  methodology  to  solve  many  complex  time  dependent  problems 
in  renewal  theory  whose  solutions  have  eluded  researchers  so  far.  This  methodology  is  based 
on  the  result  in  multiple  integrals  established  by  Sivazlian[35]  which  was  presented  in  Section 
1.6.  Multiple  integrals  provide  a natural  vehicle  to  approach  these  complex  problems  as  one 
is  essentially  dealing  with  sums  of  independent  random  variables  in  the  context  of  inter- 
renewal times. 

This  methodology  can  be  used  as  a new  way  for  deriving  most  existing  results  for  the 
time  dependent  renewal  counting  process.  Our  objective  is  to  show  that  it  can  also  be  used 
to  provide  solutions  to  many  unsolved  problems,  thus  bringing  forth  a new  perspective  to  the 
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analysis  of  renewal  processes.  Existing  methodologies  have  only  resulted  in  a partial  char- 
acterization of  the  properties  of  renewal  processes  since  they  invariably  define  the  marginal 
distribution  of  a particular  random  variable.  The  new  methodology  characterizes  more  fully 
these  processes  by  finding  joint  distribution  functions.  The  analysis  of  a process  is  incom- 
plete unless  one  has  studied  and  derived  joint  distribution  functions  such  as  the  probability 
law  of  the  process.  In  the  case  of  renewal  processes,  a partial  characterization  of  the  prob- 
ability law  ( Pr{A^(/i)  = nuN(t2)  = /i2})  was  established  by  Sivazlian[36].  Our  objective 
will  be  to  completely  characterize  this  law  (Pr{.V(/i 

is  to  be  noted  that  such  characterizations  already  exist  for  the  case  of  the  Poisson  process 
with  negative  exponentially  distributed  inter-renewal  times.  We  extend  these  results  to 
general  inter-renewal  times  and  we  derive  the  joint  distribution  of  the  renewal  increments 
and  investigate  their  asymptotic  properties. 


The  additional  new  results  that  are  derived  in  the  area  of  backward  and  forward  recur- 
rence times  fill  in  important  existing  gaps  in  the  study  of  renewal  processes,  particularly  in 
obtaining  the  joint  distribution  function  of  the  backward  and  forward  recurrence  times  and 
the  number  of  renewals.  These  results  are  used  to  generalize  the  inspection  paradox  in  the 

very  general  case  of  the  time  dependent  problem  and  arbitrary  distribution  of  inter-renewal 
times. 


We  derive  important  results  such  as  the  distribution  of  order  statistics  for  the  waiting 


times  in  an  ordinary  renewal  process. 


Another  problem  area  which  has  received  no  attention  is  that  of  the  extended  compound 
renewal  process,  a generalization  of  the  concept  of  filtered  Poisson  process  in  the  sense  of 
Parzen[31].  A second  type  Volterra  integral  equation  is  obtained  for  the  characteristic  func- 
tion of  this  process.  From  this  equation  closed  form  and  quasi-closed  form  expressions  are 
obtained  for  the  moments  of  this  process  and  several  of  its  many  applications  are  discussed 
with  particular  emphasis  to  infinite  server  queues. 

The  notion  of  the  extended  compound  renewal  process  is  further  generalized  to  that  of 
the  extended  compound  process  for  which  we  again  obtain  quasi-closed  form  expressions 
for  its  moments.  We  provide  an  example  that  demonstrates  the  usefulness  of  our  approach 


16 


to  model  systems  that  could  not  have  been  modeled  using  previously  available  analytical 
models. 


Integral  techniques  used.  The  unifying  theme  of  this  dissertation  is  the  use  of  integral 
techniques  as  a common  tool  to  derive  new  results  in  renewal  theory.  The  integral  techniques 
used  can  be  classified  into  three  basic  categories:  multiple  integrals,  integral  equations  and 
generalization  of  the  Stieltjes  integral  to  several  variables.  We  briefly  ellaborate  on  each  of 
these  techniques. 

In  Chapters  2,  3 and  4 we  use  the  multiple  integral  technique  based  on  Theorem  1 of  this 


chapter.  We  have  elaborated  on  the  imi)ortance  of  manipulation  of  multiple  integrals  in  the 
study  of  ordinary  renewal  processes.  In  Chapter  5 we  use  a second  type  Volterra  integral 
equation  in  order  to  investigate  the  characteristic  function  and  the  moments  of  the  extended 
compound  renewal  process.  We  remind  the  reader  that  the  renewal  equation  is  a special 
case  of  Volterra  equation  of  the  second  type.  Additionally,  the  notion  and  the  properties  of 


the  multiple  Stieltjes  integral  is  used  to  derive  the  moments  of  the  more  general  extended 
compound  point  process. 


The  results  obtained  exemplify  the  type  of  theoretical  knoweledge  acquired  by  this  re- 
search and  how  such  knowledge  can  be  used  to  understand  more  fully  the  behavior  of  renewal 
processes  and  its  ramifications.  In  particular  asymptotic  properties  can  be  derived  simply 

om  1 1^  many  time  dependent  solutions  obtained,  thus  obviating  complex 
derivations  used  so  far  and  which  have  mostly  relied  on  the  use  of  mathematical  analysis. 


1.11  Outline 


In  Chapter  1,  the  origins  of  renewal  theory  are  reviewed  and  definitions  of  the  renewal 
process  and  the  renewal  counting  process  are  provided.  Fundamental  problems  as  well  as 
existing  and  new  methodologies  for  solving  them  are  discussed.  Applications  of  renewal 
theory  and  novel  problems  and  extensions  are  presented. 


In  Chapter  2,  the  joint  distributions  of  backward 
investigated.  Their  covariance  function  is  determined, 
paradox  for  the  time  dependent  case  is  demonstrated. 


and  forward  recurrence  times  are 
The  existence  of  the  inspection 
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The  joint  and  marginal  distributions  of  the  order  statistics  of  waiting  times  of  an  ordinary 
renewal  process  are  studied  in  Chapter  3. 

In  Chapter  4,  the  joint  distribution  of  the  number  of  renewals  at  three  time  epochs  is 
derived.  Hence  the  joint  distribution  of  the  renewal  increments  is  determined  and  asymp- 
totic properties  are  investigated.  The  covariance  function  of  the  renewal  increments  is  also 
determined. 

The  filtered  renewal  process  and  the  extended  compound  renewal  process  are  defined 
in  Chapter  5.  The  characterisitc  function  of  a form  of  the  extended  compound  renewal 
process  is  shown  to  be  the  solution  of  a second  type  Volterra  integral  equation.  Its  solution 
is  determined  for  some  special  cases.  The  expectation  and  recursive  relations  for  higher 
order  moments  are  determined.  Applications  to  infinite  server  queues  are  provided.  The 
notion  of  the  extended  compound  renewal  process  is  generalized  to  the  extended  compound 
point  process.  The  moments  for  that  general  process  are  determined. 

Finally,  in  Chapter  6,  suggestions  lor  future  research  are  made.  Specifically,  potential 
applications  of  the  notion  of  the  extended  compound  renewal  process  in  inventory  theory 
for  an  (^,5)  policy  model  and  in  queueing  theory  for  tandem  infinite  server  queues  are 
discussed.  The  problems  of  first  passage  times  of  the  compound  renewal  process  and  of 
the  joint  characteristic  process  of  the  extended  compound  point  process  are  introduced. 
Additionally,  the  problem  of  determining  a parent  distribution  of  the  order  statistics  of  the 
waiting  times  of  the  renewal  process  is  introduced.  Such  a parent  distribution  when  sampled 
will  have  the  order  statistics  of  the  waiting  times  of  the  renewal  process. 


CHAPTER  2 

THE  USE  OF  MULTIPLE  INTEGRALS  IN  THE  STUDY  OF  THE  BACKWARD  AND 

FORWARD  RECURRENCE  TIMES 


2.1  Introduction 

A pioneer  work  in  the  study  of  tlie  backward  and  forward  recurrence  times  and  their  sum 
is  that  of  Skellam  and  Shenton[39].  The  marginal  distribution  functions  of  the  backward 
and  forward  recurrence  times  and  their  sum  lor  l)oth  tlie  time  dependent  and  steady  state 
case  are  known  in  the  literature.  The  joint  distribution  of  the  backward  and  forward  recur- 
rence times  for  the  stationary  renewal  process  has  also  been  investigated  (see  e.g.  Cohen[8] 
and  Daley  and  Vere-Jones[10] ).  Daley  and  Vere-Jones  give  a result  for  the  time  dependent 
case  that  is  not  clearly  stated.  The  joint  distribution  of  the  number  of  renewals  and  the 
backward  and  forward  recurrence  times  does  not  seem  to  have  been  investigated  so  far.  In 
a previous  work,  Sivazlia.n[38  sliows  how  multiple  integrals  can  be  used  to  derive  the  joint 
distribution  functions  of  the  numl)er  of  renewals  and  the  backward  and  of  the  forward  recur- 
rence times  separately.  In  this  paper,  we  use  again  a result  in  multiple  integrals  introduced 
by  Sivazlian[35]  to  derive  the  time  dependent  joint  distributiejn  junction  of  the  number  of 
renewals  and  the  backward  and  forward  recurrence  tinies  for  an  ordinary  renewal  process. 
Thus  we  recover  the  joint  distribution  function  and  the  marginal  distribution  functions  of 
the  backward  and  forward  recurrence  times.  The  covariance  of  the  backward  and  forward 
recurrence  times  is  derived  from  their  complementary  joint  distribution  function  for  both 
the  time  dependent  and  the  steady  state  cases.  We  also  obtain  the  time  dependent  joint 
distribution  junction  oj  the  number  cjj  renewals  and  the  sum  of  the  backward,  and  forward 
recurrence  times.  The  expectation  of  the  sum  of  the  backward  and  forward  recurrence  times 
is  derived  and  the  inspection  paradox  for  the  time  dependent  case  is  investigated. 

For  the  use  of  multiple  integrals  in  renewal  theory  the  reader  is  referred  to  Sivazlian[36, 
37,  38] 
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2.2  The  Joint  Distribution  Function  of  the  Number  of  Renewals  and  the  Backward  and 

Forward  Recurrence  Times 


In  order  to  find  the  joint  distribution  of  the  backward  and  forward  recurrence  times  and 
the  number  of  renewals,  i.e.  Pr{iV(/)  = n^B(t)  < 6^V{t)  < r}  we  consider  two  cases. 

Case  1,  N(t)  = 0.  Clearly  then  B(t)  = t and  therefore 


1.  For  0 < 9 < t 


Pr{iV(/:)  = O.B(t)  < 0,V(t)  <t}  = 0 (2.1) 

2.  For  t < 6 < oo 


Pr{.V(/)  = 0,B(t)  < 9,V(t)  < r}  = Pr{N{t)  = 0,C(/)  < r} 

= Fit  + T)-F(t)  (2.2) 

Case  2,  N{t)  = n where  n - 1,2,...  . Then  B{t)  = / - (Ti  + T2  + h 


1.  For  0 < ^^  < / 


Pr{.V(/)  = n,B(t)  < < r] 

= Pr{N{t)  = n,  T,  + T2  + ---  + 7;+i  < t + t,Ti  + T2  + ■ ■ ■ + > t - 6} 

= Pr{Ti  + T2  + ■ ■ ■ + Tn  < t,  Ti  T2  + ■ ■ ■ Tn+i  > t, 


7j  + 2'2  + • • • + < t + T,Ti  + T2  + ---  + Tn>t-e} 

f(h  )f(h)  ■ ■ ■ f(ln) 

t — 9<C.t  \ H 

{/  [/  + r — ( /|  + /-2  + • ' • + /n  )]  ~ F[t  — (ti  + ^2  T ' • * + )]}  ^^^1  (1^2  ’ ’ * 

t 

P^""\u)[F(t  + T - u)  - F{t  - u)]du  (2.3) 

t-e 


2.  For  t < 6 < oo 


Pr{iV(/)  = ujnt)  < 9.V(t)  < r} 

= Pv{N(t)  = 77,  Id/)  < r} 

— Pr{  A ( / ) = 77,  T]  T 2 2 + ' • • + Fn^i  < / + r,  } 

= Pr{Ti  + Ti  + h Tn  < /,  Ti  + 2 2 + • • • + 7"n+i  > /, 

2d  + T2  + • • • + < / + 7-,  } 
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f(h)f{t2)  ■ ■ ■ f{tn) 

0<ii-| 

{F[/  + T — (ti  + • • • + tn)]  — F[t  — (ti  + 

t 

r^^Hu)[F(t  + T - u)  - F{t  - u)]du 

0 


+ tn)]}  clti  clt2  • ' • dt 


n 


(2.4) 


Therefore  summarizing  we  liave 


Pr{7V(<)  = < 0,V(t)  < r}  = 


0,  O<0  <t 

F(t  + r)  - F(t),  t < 0 < oo 


(2.5) 


And  for  n = 1,2,... 


Pr{A(/)  = n,B(t)  < 0,V{i)  < r}  = 


r‘^^^\u)[F{t  + T - a)  - F(t  - u)]du,  0 < / 


< 


t-e 

t 


0 


T — a)  - F(t  — u)]du,  t < 0 < oo 


(2.6) 


2-- 3 The  Joint  Distribution  Function  of  the  Backward  and  Forward  Recurrence  Times 

2.3.1  The  Time  Dependent  Case 

Combining  equations  (2.5)  and  (2.6),  we  have  for  0 < r < oo 

'X' 

?r{B(t)  < 0,V{t)  <t}  = \B{N(I)  = n,B{t)  < 0,V{t)  < r} 


n=0 


nri 


r<")(u)[T(/.  + r-  «)-  F(/-  M)]f/u, 


0 <0  <t 


oz> 


F{t  + r)  - Fit)  + «)[T(/  + r - u)  - F(t  - u)]du,  t < 0 < oo 


Since 


X- 


m(/)  = /*<”*(/) 


/?.=  1 


then  for  0 < r < oc' 


Pr{5(/)  < 0,V(t)  < t} 

t 

rn(u)[F(t  + T 

^ i — 0 

F(i  + r)  - F(0  + 


— u)  — F(t  — u)]du, 

t 

m(u 


{)<0  <t 


0 


T — u)  — F[i  — u)]du^  t < 0 < oo 
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''  r 9 

/ m.(t  - f )[F(r  + y)  - F{v)]dv, 
= < *^0 


0 < 6»  < < 


F{t  + t)  - F{t)  + / m{t  - v)[F(t  + v)  ~ F(v)]dv,  t < 6 < oo 


0 


We  can  elaborate  more  on  the  second  part  of  this  eciuation: 

F(t  + r)  - F(t)  + I m{t  - c)[F(r  + n)  - F(v)]dv  = 

“'O 

= F{t  + r)  - F(t)  + I m{t  - v)F{t  + v)dv  - [ m{t  - v)F(v)dv 

C\  Jc\ 


t 


==  F(t  + r)  - F{1)  + / m(t  - v)F(t  + v)dv  - M{t)  + F{t) 

0 

= F{t  + t)  + I m(t  — v)F(t  + v)dv  —I  m\t  — v)dv 

•^0  *^0 

= F(t  F t)  — j [\  — F(t  F — v)dv 

•'o 


Thus,  we  can  write, 


Pr{i?(/)  < 0,V(t)  < r}  = < 


2.3.2  The  Limit  as  / ^ oo 


9 

•^0 

F(t  F r) 


0 <e  <t 


rn(t  — c)[T(r  + n)  — F(v)]dv^ 

t 

m(t  — c)[l  - F(t  F v)]dv,  t < 0 < oo 

0 


(2.7) 


(2.8) 


It  immediately  follows  that 
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lim  Pr{5(/)  < 0,V(t)  < r]  = lim  / m(t  - v)[F{t  F ^0  - F{v)]dv 

»-CC-  .7q 


1 

//  Jo 
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[F(t  + n)  - F(v)]dv 


where  0 < ^^  < oo  and  0 < r < ^oo.  A similar  result  is  presented  by  Cohen [8]. 


(2.9) 


2lA — The  Marginal  Distribution  Functions  of  the  Backward  and  Forward  Recurrence  Times 

The  distribution  functions  ol  the  backward  recurrence  time  and  of  the  forward  recur- 
rence time  are  results  that  can  be  found  in  the  literature(see  e.g.  Sivazlian[38]).  Here,  we 

derive  them  as  the  marginals  ol  the  joint  distribution  function  of  the  backward  and  forward 
recurrence  times. 

The  Marginal  Distribution  Function  of  the  Backward  Recurrence  Time 


The  marginal  distribution  function  of  the  backward  recurrence  time  can  be  found  if 
let  r ^ oo  in  equation  (2.8). 


we 


Pv{B(t)  <0}  = lim  Pv{B(t)  < 0,V(t)  < t} 


T—r<- 
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0 <e  <t 


< 


lim  / 777(/  - v)[F(t  + v)  — F(v)]dv, 

lim  {F(t  + t)  — / in(t  — t;)[1  — F{r  + v)]dv]^  t < 0 < oo 

r-^oo  Jq 

e 

m(t  — 7;)[i  — F(v)]dv,  0 < ^^  < / 

t 1,  t < 0 < oo 

2.4.2  The  Marginal  Distribution  Function  of  the  Forward  Recurrence  Time 


(2.10) 


The  marginal  distribution  ol  the  forward  recurrence  time  can  be  found  if  we  let  ^ ^ cxd 

in  equation  (2.5). 


Pr{V(t)  <t}  = lim  Pv{B{t)  < 0,V{t)  < r} 

6-^00 

— F[i  + t)  - I m(t  - ?;)[!  - F{r  + v)]dv 

•’o 


(2.11) 


2.5 


The  Complementary  Joint  Distribution  Function  of  the  Number  of  Renewals  and  the 

Backwaid  and  Forward  Recurrence  Times 


The  complementary  joint  distribution  liinction  of  the  number  of  renewals  and  the  back- 
ward and  forward  recurrence  times,  i.e.  Pr{yV(/)  = n^B(t)  > 0,V(t)  > r},  can  be  derived 
from  equation  (2.5).  Here  we  present  an  alternative  derivation  using  the  joint  distribution 
function  of  the  number  of  renewals  as  it  is  presented  by  Sivazlian[36]. 

Again  we  consider  two  cases. 

Case  1.  N{t)  — {).  Clearly  then  foi*  0 < r < oc' 

1.  For  0 < ^ < oc 

Fv{N(t)  = QJ3(t)  > > r)  = Pv{N{t)  = 0,A(^+r)  0} 

- Pr{Ti>/  + r} 


= I - F(t  + t) 


(2.12) 


2.  For  t < 0 < oo 


Pr{A(/)  = 0,/i(/)>^,V'(/)>r}  = 0 


(2.13) 


Case  2.  N[t)  - n where  n - 1,2,...  . Then  for  0 < r < oc' 


1.  For  0 < 0 < / 


Pr{A(/)  = n,B[t)  > e,V[t)  > r}  = 
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= Pr{  A^(/  — 0)  = N (t  t)  = n} 

t-e 

- F{t  + T - u)]du 


0 


(2.14) 


2.  For  t < 0 < oo 


Pr{A^(<)  = nJ3(t)  > 0,V{t)  > r}  = 0 


(2.15) 


Thus  summarizing  we  have 


Pr{A^(/)  = 0,B(t)  > 0,V{t)  > t] 


_ f 1 - F(t  + t),  0 < 0 < t 


0, 


t < 0 < 00 


And  for  n = 1, 2, . . . 


Pr{N{t)  = n,B[i)  > 0,  V[l)  > r} 


t-e 


(2.16) 


/*<">(«)[!  - F{t  F T - u)]du,  ^<0<t 


t < 0 < OO 

(2.17) 

2.6  The  Complementary  .Joint  Distribution  Function  of  the  Backward  and  Forward 

RecuiTence  Times 


2.6.1  The  Time  Dependent  Case 

Combining  equations  (2.16)  and  (2.17)  we  get  for  0 < r < oo 


->0 


Pr{5(/)  > 0J'{l)  > r}  = lri-{.V(/)  = n,B{i)  > 0,V(t)  > r} 


-1 


1 - F(  / . + r ) + 


/•(">[! -F(/.  + r-«.)]du,  O<0<t 


[ 0, 


t < 0 < OO 

_ <1  1 — ^(^  + 't)  + y /7i(  u)[l  — F(t  + T — u)]du^  0 < 6 < t 
lb,  t < 0 < oo 

1 — F(/  + r)  + y m[t  - e)[I  - F{v  + r)]dv,  0 < 0 < / 
lb,  i < 0 < oo 


(2.18) 


The  marginal  complementary  distril)ution  functions  can  be  obtained  if  we  let  r — 0 and 


^ = 0 accordingly. 


Pr{B(t)  > 0}  = 


^ 1 - /(/)  + y ni{t  - u)[l  - F(v)]dv,  0 < 0 < t 
lb,  t < 0 < oo 


(2.19) 


And 


Pr{C(/)  > r } — 1 — 7 ( / -f  r ) + / ///(/  — v)[[  — F(  i^  + r)]c/n,  0 < r < 'OC' 

•A) 


(2.20) 
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2.6.2  The  Limit  as  / ^ oo 


If  we  let  / ^ 00  in  equation  (2.18)  we  have 


lim  Pr{i?(t)  > 0,V[t)  > r}  = 

t—*CO 


= lim  {1  — F(  / + — t?)[l 

/-CO  Jg 

t 


F(v  + r)]dv} 


= lim  {[-  F(t  + r)+  / ni(t  - v)[l  - F(v  + T)]dv] 

/ — ./q 


e 


0 


m{t  - i;)[l  - F[v  + r)]dv 


Using  Smith’s  Theorem  this  last  equation  becomes 


lim  Pr{/y(/)  > 0^  V{1)  > r}  = 

t — rOO 

1 /'  1 

= - [1  - F{v  + t)](Iv 

/'  ^0  /' 

= - / [1  - F{  v + t)](Iv 

1 

= -/  [I  - F(v)]d-v 
/'  -h+T 


e 


[1  — F{v  + T)]dv 


0 


(2.21) 


(2.22) 


The  limits  of  the  marginal  complementary  distribution  functions  follow  immediately  if  we 
let  r = 0 and  ^ = 0 accordingly. 


lim  Pr{71(/)  y 0]  = - j [1  - F[v)]dv 


(2.23) 


And 


1 

lim  Pr{V'(0  > t]  = - [1  - F(v)]dv 

/ — CO  fl 


(2.24) 


T 


Example  1 The  Poisson  process 

As  an  example  we  investigate  the  case  when  the  inter-renewal  times  obey  the  negative 
exponential  distribution  with  parameter  A and  consequently  mean  inter-renewal  time  p = 
1/A.  For  this  negative  exponential  distribution, 


F(  / ) = 1 - e 


and 
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So  substituting  into  equations  (2.5)  and  (2.6)  we  obtain 


Fi-{N{t)  = {),D{t)<0,V(t)<T}  = I 


0,  0 < 0 < 00 

t < 6 < oo 


And  for  n = 1,2,...  and  0 < < /,  0 < r < oc 

Pi{N(t)  = nJ3(t)  < e,V{t)  < t) 

I'* 


■ 't-o  {n-iy. 

ft  1 Xu 

\-0  (n-1)! 


[1  _ e—Mi+r-u)  _ ^ ^-X(t-u)yi^ 


e-\(*-“)[l  - e~^^]du 


e ^*  ( 1 — e "'’’ ) 


— At 


t \n^^n-l 


■It-e  ( » - 1)! 


du 


= (1  - A»[/»  -(/-^)»]e-^^ 


n\ 


Similaxly  for  / < ^^  < oo,  0 < r < oc 


Pv{N(t)  = nj](t)  < 0,V(t)  <t}  = (1  - 


yn^n^-\t 

n\ 


Substituting  in  equations  (2.8)  and  (2.9)  we  obtain 


e 


Pr{V"(<)  < ^^,V'(/)  < r}  = < 


0 < 0 < oc 


•^0 


/, 


1 _ e-'M(  + 0 _ / A[1  - 1 + t < 0 < oo 


(l-e-'M/ 

= < 


\e-^^’dv. 


■^0 

0 < ^ < oc 


1 _ e-A(/  + r)  _ / t<0<^OO 


0 


(1  - e-'")(  l - e-'"  ),  0<^^<Z 

t < 0 < OO 


\0 

1 - e~^K 


As  we  easily  see  the  joint  distribution  (unction  of  the  backward  and  forward  r 


recur- 


rence times  is  dependent  on  tlie  time  {)arameter  t.  Nevertheless  the  backward  and  forward 
recurrence  times  are  independently  distributed. 

Similarly  substituting  in  equation  (2.18)  we  can  see  that 


Pr{/i(/)  > 0,V(i)  >t}  = 

I 1 - 1 + 6— + J A[1  - 1 + 0 < < t 

I 0, 


i < 0 < OO 
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f /■' 

I + J 0 <d  < t 

10,  t < 0 < oo 

_ f 0 < 0 < t 

0,  t < 0 < oo 

^-\{e+T)^  0 < 6»  < / 


0, 


t < 0 < OO 


2.7  The  Covariance  of  Bit)  and  V(f) 

The  covariance  of  the  backward  and  forward  recurrence  times  does  not  seem  to  have 
appeared  so  far.  Here  we  use  the  joint  and  the  marginal  complementary  distribution  func- 
tions of  the  backward  and  forward  recurrence  times  to  derive  expressions  for  both  the  time 
dependent  and  the  steady  state  cases. 

2.7.1  The  Time  Dependent  Case 

First  we  find  an  expression  for  E[7i(  / ) I '( / )]: 


E[5U)K(/)]  = 


r <y:>  /•  'X- 


u 

F(i  + y)]dydx  + 


Pr{7?(/)  > x,V{t)  > y}dydx 

t r OO  r t — X 


[I  — F(t  + y — u)]dudydx 

0 -^0 

nt  — X f- oo 

/ [1  — F(v)]m{u)dvdudx 

^ J 'h-U 


(2.25) 


If  we  let 


X' 


/"(/:)=/  [1  - 


the  last  equation  becomes 


E[B(t)V(t)] = I'  p(t)dx+  r r \p(t 

Jq  Jq  Jq 

— tP{t)  p I I P(t  - u)rn{u)dxdu 

-F)  F) 

= tP{t)  p / ( / — a ) P(  f — u)in(  a ]dii 

•F) 


= tP(t)p[tP(t.)]^m(l) 


u)m(  u)dudx 


(2.26) 


Next  we  find  expresions  for  E[7i(/)]  and  E[F(/)]: 


E[B(t)]  = 


X 


Pi'{  B(t)  > x}dx  = 


•^0 
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[1  - F{t)]dx  +11  - F(v)]dvdx 

/[I  - F(t)]  +11  m{t  - t;)[l  - F(v)]dxdv 

-'o  -'o 

t[l  — F(/)]  + / ?;[1  — F(v)]m(t  — v)dv 

'^0 


If  we  let 


l{(t)=  ^-F(t) 


the  last  equation  becomes 


(2.27) 


E[i?(/)]  = tR{t)  + [tR{t)]  * m(t) 


(2.28) 


Similarly, 


E[I/(/)] 


CO 


Pr{V(/)  > y} 


u 


CC'  /•  oc-  /•  t 

[1  - F(t  + y)]dy  + / / ni{t  - c)[l  - F(t  + y)]dvdy 

./Q  •>'o 

= F(t)  + P(t)  m(t) 


(2.29) 


Combining  relations  (2. 26),  (2.28)  and  (2.29)  we  have 

Cov[B(t),V(t)]  = E[B(t)V(t)]  - E[7J(/)]E[E(C] 

==  tP{t)  + [tP(t)]  * rn{t)  - {P{t)  + P{t)  * m{t)}{tR{t)  + [/iZ(/)]  * m(t)}  (2.30) 

Note  that  although  this  is  not  a closed  form  expression,  nevertheless  the  quantities  in  the 
right-hand  side  of  equation  (2.30)  lia.ve  a structure  similar  to  that  of  the  renewal  equation 
and  thus  we  can  easily  obtain  their  Laplace  ti*ansforms.  * 

Example  2 The  Poisson  process 

Again  as  an  example  we  calculate  the  covariance  function  for  the  negative  exponential 


distribution 


OZ‘ 


P{t)=  I [I  - I + e-^‘’]dv  = 

■ ' t A 


. — \t 


And 


Au 
a 


A 


t 

Xdu  — I ue~'^^du 


/\  ./  Q 

e— , r 1 


[iP{t)]  * m(t) 


0 
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So, 


E[fi(OV(/)] 


te  e 


A 


r'‘  + l'  + x5  = 150 


Also, 


E[5(/)]  = te-^^  + / Xte-'^dt  = te-^^(t  + ^ ) + ^ = ^(1  - e~^^) 

0 AAA 


\t 


-xt 


1 . 1 1 


-Xt 


And 


-Xt 


t f.-xt 


^ I \ 

A Jq  a 


e 1 - e 

(It  = — + — 


A 


A 


— Xt  I 

~ " A 


Thus  we  conclude  that 


Co\iB{t),  V{i)]  - -X(l  - e - ~(l-e  = 0 

A^  /V 

which  is  an  immediate  consequence  of  the  independence  of  the  backward  and  forward  re- 
currence times. 

2.7.2  The  Steady  State  Case 

Here  we  use  the  limits  as  t — oc  of  the  complementary  joint  distribution  function  of  the 
backward  and  forward  j'ecurrence  times  as  given  by  equation  (2.18) 


'X'  /•  oc>  /•  X 


liin  E[/?(/)l/(/)] 

t->-oo 


[1  — F(v  + T)]dvd6dr 


[1  — F(u  + T)]dOdvdr 

//  Jq  .7q  Jq 
X /•  X' 

/ v[]  — F(v  + t)](Iv(It 

fi  Jo  -A) 

X-  /•  X 

1 — F{x 


1 


J 


f‘ F)  - V 

j /•  X-  /•  X 

//.  ./q 

1 x '^ 


u[l  — F(x)]dvdx 


— [[-F(x)]dx 

/'  Oq  / 


(3) 


6// 


(2.31) 


Moreover  we  know  that 


Therefore  we  can  write 


lini 

^X 


lim  EfE 

t—>’CC‘ 


d 


(2) 


2// 


d 


(3) 


lim  Cov[/l(/.)V'(t)]  = 


4/f2 


(2.32) 
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Example  3 Gamma  distributed  inter- renewal  times 


As  an  example  we  investigate  the  case  of  the  Gamma(A,7*)  distribution.  For  this  case 


we  have 


(2)  _ + 1)  ^^(3)  _ r(r  + l)(r  + 2) 


A2 


/r  ' = 


A3 


Substituting  in  equation  (2.32)  we  have 


lim  Cov[B(()l'(l)l  = + 

t^oo  6/v\^ 


47*2;^4 


12A2 


2.8  The  Joint  Distribution  Function  of  the  Number  of  Renewals  and  the  Sum  of  the 

Backward  and  Forward  Recurrence  Times 

A pioneer  work  on  tlie  sum  ol  the  backward  and  forward  recurrence  times  (which  is 
often  referred  to  as  the  total  life)  has  been  the  paper  by  Skellam  and  Shenton[39]  with  a 
more  general  viewpoint  of  the  concept.  Cohen [8]  gives  the  distribution  function  of  the  sum 
of  the  backward  and  forward  recuivrence  times  for  the  stationary  renewal  process.  Feller[12], 
Heyman  and  Sobel[21],  and  Daley  and  Vere-Jones[10],  give  a result  for  the  time  dependent 
ordinary  renewal  process.  Here  the  technique  of  multiple  integrals  is  applied  to  derive 
the  joint  distribution  function  of  the  number  of  renewals  and  the  sum  of  the  backward  and 
forward  recurrence  times  for  the  time  dependent  ordinary  renewal  process.  We  shall  use 
S{t)  to  denote  the  sum  of  the  backward  and  forward  recurrence  times;  i.e., 


.S’(/)=  B[t)EV[t) 


Again,  as  was  done  previously  we  distinguish  two  cases, 
Case  1,  N{t)  = 0.  Clearly  then  S{t)  — 7\, 


1.  For  0 < ^!  < / 


Pr{A'(/)  = 0,5(/)  < s}  = 0 


(2.33) 


2.  For  t < s < oo 


Pr{iV(/:)  - 0,5(/)  < .s}  = Pr{iV(/)  = 0,C(/)  < s - t} 

= Pr{/  < Ti  < s} 

= F{s)-F(t) 


(2.34) 
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Case  2.  N(t)  = n where  n — 1,2, . . . 

1.  For  0 < 3 < / 

Pr{yY(/)  = 71,  S[t)  < 6'} 

— + 2-2  + • ' • + ^ /,  Ti  + ^2  + • • • + > i, 

Fi  + 72  + • • • + Ty^  > t — s,  TnJ^i  < s} 

~ .1  J ' ' ' j * • ‘/(/n  ) 

{I  (s)  — F [t  — (t[  + ^2  + • • • + tn)]}dti(lt2  . . . dtn 

= /'  r^^Hu)[F(s)-F{t-  u)]du  (2.35) 

■F-s 

2.  For  t < s < oo 


Pr{A'(^)  = n,S(i)  < s) 


- + T-l  + h i'n  < L Ti  +T-2  + f-  Tn+l  > t,Tn+l  < 5} 


f{t\  )f(h)  ■ ■ ■ f{,tn) 

0<C^1  -|- 

{7"  (.s)  — F [/  — (/|  + ^2  + * ' * + )]}r//l<7/2  * 

t 

r("^(70[i'^s)-  F^(/-70]r/n 

0 


• • dt 


n 


(2.36) 


Thus  summarizing  we  have 


Pr{iV(/)  = 0,.9(/)  < .s}  = 


0. 


i)  < s < t 


f(s)  - F{t),  t < 3 < oo 


(2.37) 


And  for  n = 1,2,... 


Fr{N{t)  = n,S(t)  < s}  = < 


t — S 

t 


r<">(«.)[F(.s)-F(/-  «)]^/w,  0 < s < 1 


r<”>(M)[T(.s)- ,F(1- yO]dn,  / < 5 < oo 


(2.38) 


0 


2l^ — The  Disti ibut ion  luiiciioii  of  tlie  Sum  of  tlie  Backward  and  Forward  Recurrence  Times 


2.9.1  The  Time  Dependent  Case 


Combining  equations  (2.37)  and  (2.38)  we  have 


Pr{5'(F  < .s}  - E Pr{A(F  = n,S{t)  < s} 

71  = 0 
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E /'  h^Hu)[F{s)  - F{t  - u)]du, 


0 < s < t 


j n=l 


< 


t — s 


OO  f 

F(s)  - F(t)  + E / - F{t  - u)]du,  t<s<oo 

. •>'  n 


n=l  ^ 


/ m\u)[F(s)  - F(t  - ii,)]d'^ 

— ) '^t-s 


Q < S < t 


F{s)  - F[t)  F / ni(u)[F(s)  - F(t  - u)]ciu,  t < s < oc 

•^0 

I m(t  - v)[F(s)  - F(v)]di\  0 < s < t 

F(s)  - F(t)  + / rn(t  - v)[F(s)  - F(v)]dv,  t < s < oo 

•^0 


V 


We  can  elaborate  more  on  the  second  part: 


F{s)-F(t)+  I m{t  - v)[F{s)- F{v)]dv  = 

■^0 

= F{s)  - F(t)  + I m.(t  - v)F(s)dv  - I m(t 

•'0  •' 0 

= F{ s)-  F{t)F  F[ s)M [t]-  M{t)F  F[t) 


v)F{v)dv 


= ns)~i 


- F(  )] 


(2.39) 


(2.40) 


Thus  we  can  write 


• S 


Pr{5(/)<.s}  = <; 

( F{s)- 

Note  that  the  second  [)art  of  ec|uation  (2.41)  implies  that 


t>)[F(.s)  - F{v)]dv,  0 < s < t 
— F{$)],  t < s < oo 


F(t)  - A/(/)[l 


/•’(/)]  X)  ^ M(t)  < 

1 - F{t) 


(2.41) 


2.9.2  The  Limit  of  the  Distribution  Function  of  S(t)  as  t — > oo 

The  limit  of  the  sum  of  the  backward  and  forward  recurrence  times  is  obtained  if  we  let 
/ cxD  in  equation  (2.41). 


lim  Pr{.S'(0  < s} 

t—^oo 


lim  / in{t  — c)[T'(s)  — F{v)]dv 


‘ •'  u 

- / [F{s)  - F(v)]dv  = 
-II  dvdF(u) 

II  Jq 
1 /■* 

— / udF{u) 

H Jq 


1 

H J Q 


dF(  u)dv 


(2.42) 


This  result  is  also  presented  by  Cohen [8]. 
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Example  4 The  Poisson  process 


Again  as  an  example  we  investigate  the  case  of  the  negative  exponential  inter-renewal 
times  as  described  in  Example  1. 


Substituting  in  equation  (2.41),  we  obtain 


Pr{5(<)  < 5}  = 


A(e 


— At'  — As 


)dv, 


0<  s <t 


{ 1 - - A<(1  - 1 + t < s < oo 

1 


As 


1 — e 


— As 


Xte 


As 


0 < ^ / 

t < s < oo 


2.10  The  Expectation  of  the  Sum  of  the  Backward  and  Forward  Recurrence  Times  and 

the  Inspection  Paradox 

2.10.1  The  Time  Dependent  Case 

In  order  to  find  the  expectation  of  the  sum  of  the  backward  and  forward  recurrence 
times  we  use  the  fact  that 


'X' 


Pr{5(/)  > s}ds 


0 


First  we  elaborate  more  on  the  first  part  of  equation  (2.41): 


s 


0 


ni(t  - v)F{s)dv  - / rn(t  - v)F(v)dv 


0 


F(s)[M(t)  - M(t  - s)]  - M(t)  + F(t)  + / m.{t  - v)F(v)dv 


s 


t — s 


F(.s)[M(t)  - M(1  - .s)]  - M{t)  + F{t)  + / m(v}Fit  - v)dv 

''  0 


(2.43) 


Thus, 


E[5(0]=  / [i  - F{t)  F M[t)  - F(s)M[t)  F F{.$ 


s) 


0 


•^0 


t — s 1-00 

m(v)F(t  - v)dv]d.s  F [1  - F(.s)  F M{t) 


F(s)M{t)]ds 


t 


0 


[1  - F{6)  F F{.3)  - F{t)  F M{t)  - F{S)M(I.)  + F{s)M(i  - s) 


t — S f-  oo 

m{v)F{t  - v)dv]ds  F [1  - F{s)  F M{t)  - 
•'0  J t 

OO  /•  CO  /•  t 

[1  - F(s)]ds  + M{t)  / [1  - F{s)]ds  F / [F(s)  - F{t)]ds 

0 '^0  -m 

+ / F{s)M(t  — s)ds  - I I m(v)F(t  — v)dvds 

Jq  Jq  Jq 


F(s)M{t)]ds 
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+ / [F(^)  — F(/)]f/.s  + / / m(v)F(s)dv (Is 

Jq  Jq  ./q 

n'  t — s 

m.(v)F(t  - v)dv(ls 

j 

r t rtpt  — s 

+ / [F(^)  — — / / ?n( — i;)  — J^(6)]di; 

•^0  -^0  *^0 

f.L  + /^i{F(t)  + / 77i(/  - i;)F(7;)r/7;} 

l‘t  rtrt  — v 

- [Fit)  - F{s)]ds  - / 777(?;)[F(/ - v)  - 

•^0  -^0  ’^0 

f-i  + //F(/)  + //-  / 7n(/  - v)F[v)dv 

•^0 

t I't  rt  — v 

[F{t)  - F(.s)]f/,5  - / ?77(v)  / [F(i  - v)  - F(5)]rf5(it; 

./Q  •>'0  "'o 

/7  + //-^(/)  + //  / 777(^  - 7’)^^( 

•^0  -Aj 

^ /•  1/ 

77/(/.  — 7/.)  / [F(  — F(.5)]r/.Sc/77 

•^U  -^0 


And  if  we  let 


0 


then  the  last  equation  becomes 


(2.44) 


E[iS(/. )]  — //,  + //F(/)  — (Jit)  F f.tm(t)  * F(t)  — m(t)  * G{t) 

= fi  + [/^iF(t)  - G'(/)]  + 777(/)  * [fiF{t)  - G'(/)] 


(2.45) 


2.10.2  Generalization  of  a Well  Known  Paradox 

From  Figure  2.1  we  can  see  that  fiF{t)  > G'(G-  Therefore  it  follows  immediately  that 


>/^ 


(2.46) 


Equality  holds  only  when  //,F(/)  ==  G'(/),  which  is  true  for  values  of  time  {/  : F(t) 

0}( assuming  nondegenerate  distributions).  For  all  othei*  cases  strict  inequality  holds. 

Let  us  see  the  impliccitions  of  this  inequality.  Suppose  that  one  desires  to  estimate  the 
mean  inter-renewal  time  of  a renewal  ])i*ocess.  He  may  decide  to  do  so  by  inspecting  several 
realizations  of  this  process,  at  a certain  time  e])och  and  measuring  the  sum  of  the  backward 
and  forward  recurrence  times.  Then  this  result  will  be  biased  since  the  mean  of  this  sum  will 


be  gieatei  than  the  actual  mean  in  ter- renewal  time.  This  result  appears  to  be  a paradox.  It 


Figure  2.1.  Comparison  between  G{t)  and 

has  been  known  in  the  literature  as  the  inspection  paradox  and  extensive  discussion  for  it  has 
been  made  in  the  intiuduction,  where  an  explanation  was  provided  (see  subsection  1.6.7). 
It  appears  to  have  been  investigated  only  for  the  steady  state  case  (e.g.  see  Feller[12j,  Karlin 
and  Ta,ylor[24],  Heyman  and  Sobel[21]  and  Daley  and  Vere-Jones[10].  Karlin  and  Taylor[24] 
also  investigated  the  time  dependent  ca^e  for  the  negative  exponential  distribution.  Our 
result  shows  that  this  paradox  exists  in  the  more  general  case  of  the  time  dependent  problem 
and  arbitrary  distribution  of  inter-renewal  times  with  the  stated  proviso. 

2.10.3  The  Limit  as  t —r  oo 

From  equation  (2.45)  it  follows  immediately  that 

Um  E[5(/)]  = lim  {/i  + [pF(t)  - G{t)]  + m(t)  ^ [pFit)  - G{t)]} 

t—^oo  t—*oo 

= /i  H — / [i.iF{v)  - G(v)]dv  > n 

M Jo 


(2.47) 
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Example  5 The  Poisson  process 


We  use  equation  (2.45)  to  the  case  wheji  the  inter-renewal  intervals  obey  the  negative 
exponential  distribution  and  recover  the  results  of  Karlin  and  Taylor[24]. 

l.iF(t)  = |(1  - e~^^) 

A 


G(t)  = I [I  - - l + e-^^]d.s 


— \s' 


U 


e - e 


0 


•^0 


hj 

A 


te 


te 


— Xt 


Therefore 


1 


l.tF{i)  - G(t)  = ~{l  - e - ^(1  - + te 


1 


-\t 


Xt 


A 


A 


And  substituting  into  equation  (2.45)  we  get 


te 


-Xt 


E[5(/.)]  = 


t 


Xt 


//  + te  + / Xve  ^^dv 

•^0 


-Xt 


1 


p-^te-'^^  P-[  \ -e-^^)-te 

A 


Xt 


= /(  + te  + ;t(  1 - e - te 


— Xt 


Xt 


= 2p  — pe 


-Xt 


And 


liin  E[*S'(/)]  = 2// 

t-^'->0 

2.1 1 Conclusion 


In  this  chapter  we  have  complemented  existing  results  on  the  distribution  of  the  back- 
ward and  forward  recurrence  times  of  an  ordinary  renewal  process.  Namely,  we  obtained 
novel  results  foi  the  joint  distribution  function  of  the  backward  and  forward  recurrence 
times  and  the  number  of  renewals  and  for  the  Joint  distribution  of  the  sum  of  backward 
and  forward  recurrence  times  and  the  luniiber  of  renewals  for  both  the  time  dependent 
and  the  steady  state.  Hence,  we  ol)tained  novel  results  for  the  covariance  of  the  backward 
and  forward  recurrence  times  and,  finally,  we  generalized  for  the  time  dependent  case  the 

case  inspection  paradox  (see  Gakis  and  Sivazlian[13,  14]). 


CHAPTER  3 

THE  USE  OF  MULTIPLE  INTEGRALS  IN  THE  STUDY  OF  THE  PROBABILITY 

LAW  OF  THE  RENEWAL  COUNTING  PROCESS 


3.1  Introduction 

In  this  chapter  we  present  several  results  that  complete  the  characterization  of  the 
renewal  process.  Namely,  we  study  the  joint  distribution  of  the  number  of  renewals  at 
three  time  epochs.  Hence,  we  deiive  the  joint  probability  law  of  the  renewal  increments 
(for  extensive  discussion  see  Section  1.4).  Again  we  derive  the  results  using  Theorem  1 of 
Chapter  1.  Sivazlian[36]  has  used  the  same  methodology  in  the  study  of  the  joint  distribution 
of  the  number  ol  renewals  at  two  time  epochs.  Finally,  the  joint  distribution  function  of 

two  waiting  times  is  used  to  obtain  the  covariance  junction  of  the  number  of  renewals  and 
of  the  renewal  increments. 

3^2 The  Joint  Distribution  of  the  Number  ol  Renewals  at  Three  Time  Epochs 

3.2.1  Problem  Statement 

Let  {Aj,z  = 1,2,...}  be  a i*enewal  process  and  {N[t)^t  > 0}  Consider  three  time 
epochs  ^1,  ^2  ^iid  ^3  where  0 < C < ^2  < ^3-  Our  purpose  is  to  find  an  expression  for 
Pr{7V(/i)  = n\,N[t2)  — ^^2^  A(^3)  = ^^3}  vvhere  7?i,  ??-2,  773  are  nonnegative  integers  and 

0 < ?7i  < 772  ^ ^^3- 

As  we  did  in  the  previous  chapter  we  derive  our  results  from  the  multiple  integral 


' f(^n)[^  - F(t  - Xi  - X-2 


Xn)]dxi  dx2  . . .dXn 


where  Tv  is  the  region  of  integration  that  describes  the  desired  event. 
Evaluation  of  Pr{AH/G  /7i.A4/>)  = n>.NiU)  = 77^} 


For  the  cases  that  the  problem  of  evaluation  of  Pr{Y(/i)  = /7i,  A(/2)  = 772,  A(/3)  = 773} 
1 educes  to  a pioblem  ol  evaluating  Pr{A^(/2)  = /72,iV(/3)  = 773}  we  use  the  results  from 
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Sivazlian[36].  In  all  cases  examined  we  assume  0 < < ^2  < ^3- 

1)  Evaluation  of  Pr{iV(ti)  = 0,  A^(t2)  = 0,iV(/3)  = 0}.  Clearly  in  this  case 

Pr{N{U ) = 0,  iV(/2)  = 0,  iV(/3)  = 0}  = Pr{A^t3)  = 0} 

= 1 - F{ts)  (3.1) 


2)  Evaluation  of  Pr{A^(ti)  = 0,  A'^(/2)  = 0,N(ts)  — 1}.  Clearly  in  this  case 

Pr{A^(ti)  = 0,A^(f2)  = 0,1V(<3)  = 1} 

Pr{./V(/2)  = 0,A'(/,3)  = 1} 

h. 

/(.c)[l  - f[i3  - x)]dx 


(3.2) 


3)  Evaluation  of  Pr{A'(C)  — 0,N{t2)  = 0,  A^(t3)  = ?i}  where  n > 2.  Clearly  in  this  case 


Pr{A^(ti)  = 0.iV(/2)  = 0,A'(f3)  = 1}  = Pr{A'(/2)  = 0,A'(73)  = n) 

ts  — 

f{y^)  / — F(/.3  — X — w)]dx  d'W 

to  ’h) 


(3.3) 


4)  Evaluation  of  Pr{A'(F)  = 0,  A (/2)  = E-^''(^3)  = !}•  Clearly  in  this  case 


Pr{7V(F)  = 0,A^(/2)-EA^(/3)=l}-  / f(xi)[l  - F(ts  - xi  - X2)]dxi 

n 


where 


Tv  = {x  : /|  < .ri  < 12} 


and  thus 


<2 


Pr{A'(/i ) = 0,  ^■(^2)  = 1,  N{h)  = 1}  = / /(,r  )[1  - F{h  - x)]dx 


(3.4) 


5)  Evaluation  of  Pr{A^(/i)  — 0,  A'(/2)  = 1,  A"(/3)  = 2}.  Clearly  in  this  case 


Pr{iV(/,)  = 0,  A^(/2)  = EiV(F)  = 2} 


f{x\  )f(x2)[\  - Fits  - X[  - X2)]dxi  dx2  • • >dx 


n 
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where 


n = {X  : /i  < Xi  < t.2,  t-2  < Xi  + X2  < ^3) 

= {x  : ii  < X\  < /2,  t2  — .X'l  < X'2  < ^3  — Xi  } 


and  thus 


Pr{/V(/i)  = 0,iV(/2)  = l,.V(/3)  = 2} 

to  rt2.  — iu 

/(«’)  / - F{t.3  - X - w)]dx(ku 


tl 


io  — w 


(3.5) 


6)  Evaluation  of  Pr{iV(/i)  — 0,2V(/2)  = l,N(ts)  = n]  where  n > 3.  Clearly  in  this  case 


Pr{A^(^i)  = 0,A^(/2)  = PA^(/3)  = n} 


)[1  - l'\^3  - '^^'1  - - • • • - Xri)]dxi  (1x2  ’ * ' dx 


n 


■R 


where 


' I ^ 


or  equivalently 


and  thus 


{x  : < ,i:,  < t-2,  t-2  - Xi  < X2  < <3  - X-i, 

0 < .T3  + • • • + X-a  < h — X]  - X2} 


Pr{N(U)  = (),A'(/2)  = 1,A'(^3)  = 2} 

to  I’t^.  — v I'tz  — w — v 

/(■'’)  / /(«.’)  / 

•'0  -Uo-V  '^0 


[1  — /'(/a  — X — lu  — v)]dx  dwdv 


(3.6) 


7)  Evaluation  of  Pr{A^(/i ) 


= /?,  A'd/a)  = /i}  where  n > 2.  Clearly  in  this  case 


Pr{A^(/i)  =2  (),A^(/2)  = ihN(ts)  - 

~ j j ' ' ' j )/(^^*2  ) • • -/(‘^‘n  ) 

R 

[1  - F(t  - X[  - Xo  


Xn  )]d:r  i dx  2 • • • dx 


n 
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where 


/v  — { X ! / 1 X I ^ ^ 2 ? ^ 1 1 2 “1“  ‘ ^ ^ 2 } 


or  equivalently 


JZ  — {x  : /]  < ,zq  < /-2 7 0 < .7*2  + • • • + .i*n  ^ ^2  ~ } 


and  thus 


1^*{.Y(/i)  = 0,.V(/2)==  /Z,/V(/3}-7^,) 
t2  I‘t2  — W 

/( ^^^)  / - F{ts  — X — iu)]dx  dw 


''ti 


0 


(3.7) 


8)  Evaluation  of  Pr{ i\(/|)  — 0,  A (/2)  = A (/;3)  = n+  1}  where  n > 2.  Clearly  in  this  case 

Pr{A^(/i ) = 0,  A'(/2)  = n,  Nits)  = n + 1} 

- ././*’’.//(  *^‘l  )/( '^‘2  ) * * • /( ) 
n 

[1  - F(t  - X[  - X-2  :i*ri+l  )]^7x*i  dX‘2  • • -d.X'n+1 


where 


{x  I /]  < ,7*1  /2,  t]  < .1*1  H“  .1*2  “h  * * * ~l"  l‘n  ^ 

t l < -7;i  + ,7  * 2 + * • • + .7:  71-1-1  < ^3} 


or  equivalently 


F — { X ! / 1 < ,7: 1 ^ / 2 r 9 < ,7: 2 -f"  • • • -f"  .7: 71  ^ / 2 ~ .7: 1 , 


and  thus 


t.2  - .1*1  - .12 


Xyi  <C  .^7i-|-i  ^ ts  .7*1  X2  ’ • * .l*n} 


Pr{A^(C)  0,iV(t2)  = n,A^(/3)  = /^+  1} 


t2  rt2—v  rtz—xu  — v 

nv)  / / /(x) 

^1  0 J i^  — W — V 


[i  — F(t3  — X ~ w — v)]dx  dwdv 


(3.8) 
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9)  Evaluation  of  Pr{A^(/i)  = 0,iV(/2)  = 'n,N{ts)  = ni}  where  n > 2 and  ni  = n + 
m >2.  Clearly  in  this  case 


/ • • \f(Xn^)[l  - F{t  - Xi  - X‘2  Xn^)]dXi  clX2  ' * ‘dXn^ 

n 

where 


Ti,  — {x  : t\  < X]  < t.2^  t\  < X[  + + • * • + X^i  ^ ^2? 

^2  < + X2  + • • • + ^*71-1-1  < /a,  ^2  < ^‘l  + 3:2  + • • • + Xj^^  < ts} 

or  equivalently 


and  thus 


7^  = {x  : /i  < ;ri  < /2, 0 < ;r2  + * * * + < h - x^ , 


1 2 X I X 2 


n ^ Xfi-^i  ^ /,3  ,Xq  X*2 


X 


n 1 


0 ^ •^'n+2  + • • * + Xn,  < I3  — X\  — X*2  — 


X 


n-fl 


} 


Pr{A^(^i)  = (),.V(/2)  = n,A'’(/3)  = nj} 


^2  rt2  — u rto^—v  — u rto—iu  — v — u 

f(u)  / / fiiv)  / 

'^0  X t2-v-u  0 


[1  — F(/3  — X — lu  — v)]dx  diudv  da 


(3.9) 


10)  Evaluation  of  Pr{A^(/i ) = n,  Nih)  = n,  A' (^3)  = /;}  where  n > 1.  Clearly  in  this  case 
PrjiVCi)  = n,A^(/2)  = n.Nih)  = n} 


where 


/(•*'l  )/(.*''2)  • • ■ f(Xn)[i  - F{t  - ,X'i  - X2  - • • • - Xn)]dxi  (1x2  ' ' ‘ dx 


n 


t: 


and  thus 


n 


{ X ! 0 <C  X ] ~h  2 “h  ' ’ * “1“  n ^ F } 


/•  h 

Pr{iV(/i ) = n,  A'(/2)  = n,  A'(/3)  = n}  = / /*<’9(,r)[l  - F(is  - ;r)]f/.r 

“'o 


(3.10) 
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11)  Evaluation  of  Pr{A^(^i)  — n^N{t2)  = — n + 1}  where  n > 1.  Clearly  in  this 

case 


Pr{7V(/i)  ..  n,W{t2)  = n,N(ts)  = 7i+  1} 


• • \f(Xn^i)[l  - F{t  - Xi  - X2  Xn-^i)]dXi  clX2  * * • clXn^l 


7^ 


where 


7^  = {x  : 0 < .Ti  + a*2  + • - + Xn  < t^h  < + ^2  + • • • + ^n+l  < ^3}  (3.11) 


or  equivalently 


Tv  — {x  : 0 < .1*1  + *^‘2  “1“  • • * + Xji  < ti , 


i‘2  X2  * ’ * Xyi  <C.  Xji^i  ^ ^3  ,X*  2 X2 


} 


and  thus 


Pr{A^(/i)  = rKN(t2)  = ihN(h)  = 77} 


j'tz-W 

/ (x)[\  - F(^3  - X - w)]dx  ciw 

0 ^^12-10 


(3.12) 


12)  Evaluation  of  Pr{iV(/|)  = n,N(t2)  = = fii]  where  77,  > 1 and  m = n m, 

m > 2.  Clearly  in  this  case 


Pr{7V(/l)z.77,.V(/2)  = 77,.V(/3)  = /il} 


)/(-^^'2)  • • ' f(Xni  )[1  - F(t  - Xi  - X2  - • • • - Xn^  )]dxi  dx2  ' ' ' dx 


7ll 


n 


where 


Tv  {x  . 0 .Ti  -f-  d*  * ' * "h  Xji"^ti^t2KXi-\-X2~\~’''~\~  ^’n+1  ^ ^3 7 

i‘2  < *'^'1  + X2  + • • • + Xji^  ^ ^3} 


or  equivalently 


F = {x  : 0 < xi  + .7:2  + • • • + Xn  < /i , 

^2  X 1 .1 2 * * ’ X',1  <C  ^ ^3  ,X*  I ,X‘2  * * * — Xfi^ 

0 < Xn-\-2  + • • • + Xn^  < F - Xi  - X2  Xn^l  } 
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and  thus 


Pr{N(U)  = n,N{l2)  = n,N{ts)  = 7Zi} 

ti  rt:i  — v rtz  — v—w 

/ fiw)  / 

0 '^t2-v  '^0 


[1  — F{t^  — X — lu  — v)]dx  dwdv 


(3.13) 


13)  Evaluation  of  Pr{A^(/i)  — ??,  iV(/2)  = n + 1,  ^(^3)  rr  n + 1}  where  n > 1.  Clearly  in 


this  case 


Pr{7V(/i)  - n,N(t2)  = + l,iV(/3)  = n + 1} 


)/(«^'2)  • • • K^ni-l  )[1  - F{t  - Xi  - X-2  .X‘n+1  )]dxi  dX2  * * 'dXn^i 


n 


where 


Tv  = {x  : 0 < xi 


• • • 


+ :r^  < t[ , /.|  < x\  + X2  + • • • + ^ ^2} 


or  equivalently 


Tv  — { X : 0 < .r  I + ,T  2 + • • * + .1*  / 1 , 


X2  * ’ * X ji  ^ Xji^i  ^ ^2  1 ^2 


Xn] 


and  thus 


Pr{iV(/i)  = n,iV(/2)  = //  + 1,A^(/3)  - n + 1} 

rto  — w 

/ /(^?‘)[1  - T^(^3  - ^ - iu)]dx  dw 

•"0 


(3.14) 


14)  Evaluation  of  Pr{/V(/i)  = //,A/(/2)  = 77,  + l,.V(/3)  = n + 2}  where  77  > 1.  Clearly  in 


this  case 


Pr{TV(i^i)  — 7 7,  A (Z  2 ) — ^ i + 1,  A'^(  / 3)  — n 2} 


/(•^*i)/(«^*2)  • • •/(.rn-f2)[i  - F(t  - xi  - ,1*2  ,r,^+2)]da;i  dx2  • • •dxn^2 


n 


Tv  {x  . 0 < ,l  I -|-  ,7.‘2  -|-  • • • -j-  Xji  ^ f I ->F  *^1  4“  *^2  4“  * * ‘ 4"  ^ ^2? 

^2  < 4"  X2  + * • • 4-  Xn^2  ^ ^3} 


where 
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or  equivalently 


7v  — { X ! 0 <C  .rq  -|-  ,T  2 “h  ' * * “1“  n ^ ^ 1 ^ 


and  thus 


/ l ctq  .7  -2  * * * *^*n-l-l  — ^2  ^*1  ^2 


— X 


n •) 


ti  X{  X'2  ' ' * .1*72^^!  .1  77_|_2  ^ ^3  ^2 


Pr{yV(/^)  = n,N(t2)  = n + l,iY(/3)  = n + 2} 


rt2  — v rts—v—w 

/**”*(«)/  f{w)  f{x)[l  - Fits  - X - iv)]dx  divdv  (3.15) 

0 t\—V  t2—V  — W 


15)  Evaluation  of  Pr{A'  (t[ ) = /?,,  A' (/2)  = n+l,  A' (/3)  = ui } where  n > 1 and  ui  = n+l  + m, 
m > 2.  Clearly  in  this  case 


Pr{A^(/i)  = n,A^(/2)  = n+  i,A^(/3)  = m}  = 


f(^\  )f(^'2)  • • ' )[1  - F(t  - Xi  - X2  - • • • - Xn^  )]clxi  (1x2  ' ‘ ' clx 


n\ 


n 


where 


Tv  {x  . 0 < 7. 1 + X2  + • • • + Xji  ^ t{^t\  < X\  + .X*2  + • • • H"  Xji^i  < ^2? 


^2  < •'^'1  + 7:2  + • • • + 7:72  , < /.3} 


or  equivalently 


Tv  — {x  : 0 < 7:1  + 7;*2  + • • • + ;i*7i  < , 


7/*l  7/* 2 * * * 7. 72  <C  T.*72_|_i  ^ ^2  7.* 2 


— X 


n •> 


and  thus 


/2  - Xi  - X2  - 


77.  1 ^ » J -I-  ^ t 7/ 


n-\-2  — ^3  ’^'1  *^‘2  * ’ * i 


0 < :i’„+3  + • • • + ;i’„j  < /,3  - .7.’i  - X2  - ■ ■ ■ - ,x-„+2} 


Pr{iV(/i ) = n,  N(t.2)  = n + I,  Nits)  = n + 2} 


^1  /'  ^2  ~ U fts—  U — V 

/♦<”)(■«)  / fiv)  / /(u>) 

^ ' ti—U  ^2  — U — V 

to  — u — y — ii, 

J ( 7‘  )[1  — F{  F — — w )]dx  (I  w dv  du 

0 
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16)  Evaluation  of  Pr{iV(ii ) = n,N(t2)  = ni,N(t^)  = ni}  where  7i  > I and  nj  = n + m,m  > 
2.  Clearly  in  this  case 


PT{N(h)  = n,N(t2)  = iH,N(t3)  = rH} 

j • • ‘ )[1  - F{t  - Xi  - x-2  Xn^)]dxi  dX2  • • 'dXn^ 

n 

where 


TZ  — {x  : 0 < .I'l  + x-2  + • • • + .i'n  < + X2  + • • • + Xn+l  < t2 


t\  < X 


• • • 


+ < t'l] 


or  equivalently 


and  thus 


TZ  — { X : 0 < .r  j + 2*  2 + * * • + 71  ^ ^ 1 , 

tx  - Xx  - X2  Xn  < 2‘7i+1  < h ~ 2*1  ~ X2  2*^, 

0 < 2\i_|_2  + • • • + 2^ij  < 12  — 2‘1  — 2*2  — • • • — Xj^^x  } 


Pr{/V(/i)  = n,N{t2)  = ni,iV(/3)  = ^i} 


0 


t2  — V 


to—V—W 


f 


*(rii  — n—  1 ) 


/ f{w) 

0 •'tj-v  -^0 

[1  — F(t3  — X — w — v)]dx  dwdv 


(a;) 


(3.17) 


17)  Evaluation  ol  Pr{A'(C)  — — n\,N(t3)  = n.\  + 1}  where  ra  > 1 and  rii  = 

n + m,m  > 2.  Clearlv  in  this  case 


Pr{A^(ti)  = n.Nih)  = «i,.'V(/3)  = «i  + 1} 

= J J ' ' ' J )/( •'*'2  )•••/(  •'-'ni  +1  )[1  - F{  t - ,Ti  - a,'2  - 

Ti 


'^Tll  -|-1  d^  2 ’ * * -f-1 


7^ 


{x  : 0 < 2*1  + 2'2  + • • • + Xa  < /l , /i  < 2*1  + 2*2  + ’ • * + Xn^X  < 


i\  < *^‘l  + 2*2  + • • • + X,i^  < /2,  /2  < 2*1  + 2*2  + * * * + ^ ^3} 


where 
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or  equivalently 


^ |x  I 0 <C  X\  “h  “j“  * * * H“  ^ 

tl  — .1*1  — :i*2  — • • • - Xn  < .X*n+1  ^ t-2  — — X'2  — • • • — Xn^ 

0 < X;^_|_2  + • • • + ^*nj  < t‘2  — X'l  — X2  — • • • — .X* 71-^1 , 

h - Xi  - .1*2  .I'm  < *^'nl+l  < ts  - Xi  - X2  Xn^  } 

and  thus 


Pr{iV(/i)  — ??,,A(/2)  — ni,A^(/3)  _ 7Zi  + 1} 

t\  rt2~u  rt2  — u — v 

/**">(»)  / f{v)  / 

0 *^0 
to  — a—  V — w 

/(;i*)[l  — F{ts  — X — lu  — V — u)]dx  diudv  du 

^2  “ U—  V—  W 


(3.18) 


18)  Evaluation  of  Pr{iV(  /i)  — /?,  A^(/2)  = A^(/3)  = 772}  where  n > l,/ii  — n m^m  > 2 

and  712  = rii  + k,k  > 2.  Clearly  in  this  case 


Pr{A'(/i)  = 7i,iV(/.2)  = nx.N[F)  - 112] 


)/(-^*2)  * * ’ f{Xn2  )[1  — — X2  — • • • — Xri2)]dxi  dx2  * * * 


^2 


where 


Tv  = {x  : 0 < .1*1  -f  X'2  + * * • + X71  < /i , 

/i  < .ii  + 1*2  + * * * + 1,1+1  < ^iCi  < .1*1  + .1*2  + h I'm  < t2, 

^2  ^ ‘^‘1  + X2  + • • * + I'ni  +1  ^ ^3?  ^2  ^ *^*1  + X2  + • • • + X712  ^ ^3} 

or  equivalently 


Tv  — {x  : 0 < .7*1  + «7*2  ' F Xji  < C ^ 


h - - 1*2  - • * * - < *^‘n+l  < ^2  “ ~ X2  - • • • - 1*^, 

0 < X,^^2  + * * * + Inj  < ^2  - ‘i'l  - X2  - • • • - l*,^^i , 
h - X\  - X2  - • • • - Xn^  < Xjn^x  < ts  - .li  - .12 


0 < lni+2  + * • • + 1,12  < ts  - Xi  — I2 


^*71]  +1  } 
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and  thus 


Pr{N{ti)  = 71,  A' (<2)  = Hi,  Nits)  = 712} 

ti  rto  — u rtr>—u  — v 

/ f(v)  / ' 

0 -'ti-u  -^0 

ts  — u—  v — w r to—u~v—  iu—x 

fix)  / y*(«2-m-i) 

t2  — U — V—  W 0 


(y) 


[1  — F{  ts  — u — V — w — X — y)]dy  dx  dw  dv  du  (3.19) 


Alternatively,  we  have  if  we  let 


/*<“)(/)  = Uoit) 


where  Uq  is  the  unit  iin])ulse  fiiiictiou  defined  as  follows 


0+ 


uo(x)dx  = 1,  and  uo(t)  = 0 for  t / 0 


0- 


we  can  write  the  expression  lor  Pr{  A (t\  ) = iii , A^(/2)  = n-2^  ^^(^3)  = n^}  in  a more  compact 
form: 


1.  For  n = 0, 1, 2, . . . 


Pr{Nih)  = 7i,Nit2)  = 77,A^(/3)  = 77}  = / /*‘">(7/)[l  - Fits  - y)]dy 


0 


2.  For  n = 0, 1, 2, . . . and  rii  — v + /n,  m = 1,2,... 


(3.20) 


Pr{A'd/i)  = /7,Ad/2)  = n,Nits)  = 77,} 

I'  /*  t2,—‘W  /*  ts  — W — X 

/ ./■(.<•)  / 

•"0  '^0 

[1  — /^(/:3  — lu  — .7;  — y)]dydx  d/w 

h rt^.—iLf  rto—w  — x 

/ fix)  / r<'"-'>(7/) 

■'0  “'(2-u-  “'o 


[1  — Fi  ts  — w — X — y)]dydx  d 


w 


(3.21) 


3.  For  77  = 0, 1, 2. . . . and  77 , = 77  + 777,  777  = 1.2 


Pr{A'-(^l)  = 77.  /V(/2)  = 77i,A7/3)  = 7il} 
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t\  I‘t2  — W rt2  — U)  — X 

/ fix)  / (2/) 

0 t\—w  *^0 

[1  — F{i^  — w — X — y)]dydx  dw 

t\  rt2  — w rt2—w—x 

/ fix)  / 

■'0  -^ti-w  •'o 

[1  — Fits  — w — X — y)]dydx  dw 


(3.22) 


4.  For  n = 0, 1, 2, . . ..  ;?  j = n + m , m = 1,2,...  and  ?i2  = + k,  k = 1,2,... 


Pr{'V(/i)  = n,lV(/2)  UuNits)  = ri2}  = 

il  rt2  — u rto  — u—v 

/ f{v)  / ' 

t2,  — u — v — xu  riz  — u — v—w—x 

fix)  / 

to  — u — v—w  *^0 

[1  — F(/;3  — a — V — w — X — y)]dydx  diudvdu 


/*(m- !)(,„,) 


rt2—u  rt2  — u — v 

/**”'(«)  / fiv)  / 

•"0  -^0 

1 3 — ii.  — ii  — u;  f t '2,  — U — V — W — X 

f(-i-)  / 

t2  — U — V—  W '^0 


(y) 


[1  — 7^’(/.3  — a — V — w — X — y)]dy  dx  dwdv  du 


(3.23) 


3.3  The  .Joint  Probability  Law  of  the  Renewal  Increments 
The  next  step  is  to  determine  the  distribution  of  the  increments  i.e. 


Pr { iV ( / 2 ) - N ( / 1 ) = 111  1 , N ih)  - N it 2)  = m2 } = 


CC* 


= ^ Pr{iV(/,)  = 
=1 

and  the  limit  as  t — oo. 


uu  ^ih)  = - n-i  + nil  + ^^2} 


3.3.1  The  Time  Dependent  Case 

Again, for  0 < /i  < t2  < /a  < 00  we  distinguish  four  cases: 
1.  For  mi  = 7112  — d 


Pr{iV(i2)  - NiU  ) = 0,  Nits)  - Nih)  = 0}  = ^ Pr{iV(2i ) = n,  Nit.2)  = n,  NUs)  = n} 


71=1 


^ ^ Fits-y)]dy 


71=1  ^ 


0 


777,(?/)[l  - Fits  - y)]dy 


(3.24) 
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2.  For  mi  = 0 and  = 1,2,... 


Pr{7V(/2)  - N(h)  = 0,Nits)  - N{t2)  = m2} 


00 


= ^ Pr{A^(<i)  = n,N(t2)  = n,Nits)  - n + m2] 


rt^  — w rt2.  — w — x 

/ j{x)  / 

'^t2-W  "'0 

[1  — F(t3  — w — X — y)]dy  dx  dw 

'i\  rts  — w rts—w—x 

m{w}  / fix)  I 

t2—W 


0 


0 


[1  — F(l3  — w — X — y)]dy  dx  dw 


(3.25) 


3.  For  mi  = 1,2,...  and  m2  = 0 


Pr{A'(/2)  - A'(/i)  = rnuNits)  - N (i.2)  = 0} 


OC' 


= ^ Pr{A^(/i ) = n,  N{t2)  = n + mi,N{ts)  = n + ??ri} 


n=l 


t\—w 


[1  — F[F  — w — X — y)\dy  dx  dw 


0 


il  rt2  — w rt2  — w — x 

m{w)  / fix)  / 


(y) 


[1  - /’(I3  - w - X — y)]dy  dx  dw 


(3.26) 


4.  For  mi  = 1,2,...  and  m2  = 1.2,... 


Pr{7Y(/,2)  - vV(/,i)  = mu  Nits)  - Nit.2)  = m2} 


<2C> 


— X!  (^1 ) — n,  N(i.2)  = n + nii,  N (t-s)  = n + mi  + m2} 


n=l 


. * rt2-u  rt2-u-v 

= E / .r'"'(«)  / fiv)  / /*<’”>-'>(«)) 

■’li-u  “'0 


n=l  0 


0 


^3  —u—v—  iu  r — U.  — V—  w—x 

/(.r)-/  2/) 

t2  — U — V—W  •"'0 

[1  — i^'(/3  — w — V — w — X — y)]dydx  diudv  du 

t\  rt2  — u rt2—u  — v 

miu)  / fiv)  / ' 

"'0 


(tn) 
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ts~  u — v — w rt^—u  — v — vj—x 

fix)  I 

t2~ U — V—W 


U 


[1  — F[t^  — u — V— w — X — y)]dy  dx  dw  dv  clu 


(3.27) 


3.3.2  The  Limit  as  /i  ^ cxp 

Using  Smith’s  key  renewal  theorem  we  obtain  for  t2  = /i  + ri  and  t.3  = t.2  + T2: 

1.  For  mi  = m2  = 0 

^lim^PT{N(t2)- N(ti)  = 0,N(t3)- N{t2)  = 0}  = - / [I  - Fin  + T2  + y)]dy  (3.28) 


2.  For  mi  = 0 and  m2  = 1,2,... 


lim  Pr{iV(/2) 


A'(/l)  = 0,  iV(/,3)  - A'(/.2)  = m2} 


2 r r "1“  ^2  “f"  ^4^ 


/(  X ) 


n -\-T2-\-W-X 


u , / / 

r 0 ’^71  + It;  '^0 

[1  — F(ti  + T2  + — X — y)]dydx  dw 


3.  For  mi  = 1,2,...  and  1112  = 0 


lim  Pr{A^(/2) 

-^oc> 


N[h)  = mi,A^(Z3)-  A^(/2)  = 0} 


2 /'OC>  r T\-\-w 


/( X ) 


T]  -f  tt;  — 3: 


u,  , , 

f.1  ./  Q .7^^  J Q 

[1  — F(ri  + T2  + to  - ,T  — y)]dy  dx  dw 


4.  For  mi  = 1,2 and  = 1.2... 


lim  Pr{  N ( h. ) - A'  ( / 1 ) = ;?ti , N ( <3 ) - N ( t2 ) = m2  } = 

I j — ► CC' 


//  7o 


1 /'  /*  /’ 

/(o)  / 

a -^0 

“t  ^2  "f  — <7  — It;  /•  n -f"T2  + u— t;— tt;  — a,' 

/(.r)  / 

Ti-}- U — V—  W '^0 


[1  - F(r, 


a 


I’  — le  — .1*  — y)]r/^  d:r  diudv  du  (3.31) 
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3.4  The  Covariance  Fimction  of  the  Number  of  Renewals  and  of  the  Renewal  Increments 

In  this  section  we  derive  the  covariance  function  of  the  number  of  renewals  and  of  the 
renewal  increments  in  an  ordinary  renewal  counting  process.  Of  course,  one  could  have 
used  the  joint  distribution  of  the  number  of  renewals  as  given  in  Sivazlian[36]  to  derive  the 
covariance  functions.  However,  the  present  methodology  provides  a much  simpler  and  a 
more  direct  approach.  First,  we  write  an  expression  for  the  joint  distribution  function  of 
two  waiting  times  which  can  be  easily  verified 


y 


z — u 


< 2}  = / r^^Hu)  f*^‘-^Hv)dvdu 


0 


■^0 


(3.32) 


Next,  we  find  an  expression  for  E[A' ( )A'( /2 )]  for  0 < ti  < t-2  < 00 


•yO  OC' 


E[N{U)N(t2)]  = 


Y,  E > k,N(t2)  > /} 

A.-1  /=1 
00 

E E < tuWi  < t.2} 

k=i  1=1 

k 00  00 

E E < fi}  + E E < h,Wt  < x} 

k=l  l=\  k=l  l=k+l 


(3.33) 


We  consider  each  term  in  tlie  right  hand  side  of  (3.33).  First 


k 


<yo 


EE>^>-{iU</i} 

A:  = l /=1 


k=l 

>yy 


k=l 

<yz>  00 


= 12  kY^  Pr{N{ti)  = m} 


k=[  rn  = k 
'yz'  m 


= E E 


m = \ k=l 
<yz‘ 


= E 


m = 1 

1 


771  ( 777  + 1 ) 
2 


Pr{A^(ti ) = 777} 


i,E[N'^ih)  + N(U)] 


2 


(3.34) 


Also,  using  expression  (3.32),  the  second  term  on  the  right  hand  side  of  (3.33)  becomes 


00  00 


'>0  (>0  „ ^ 


1 f’t2  — U 

I f*{l-k) 


E E < /,,in  < /2}  = E E / i / 

k=ll=k+-l  Jq 


(v)dvdu 
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^1  rt2—u 

Y.r^'Hv)dvdu 

0 k=i  -^0  ,-=l 

f-ti  f‘t2-U 

m(u)  / m(v)dvdu 
0 -^0 
h 

m{'u)M {t2  - ii)du 

0 


Thus,  substituting  (3.34)  and  (3.35)  in  (3.33)  we  obtain 


E[^^(/l)iV(^2)]  = /'*  m{u)M{t2  - u}du+  E[^"(^i)]  + E[iV(^i)] 

■'o  2 


We  know  (see  Daley  and  Vere-Jones[10] ) that 


E[A'^(ti  )]  = M{t\)  + 2 / rn(  u)M{t-i  - u)du 

2u 


We  can  now  obtain  an  expression  for  Cov[A- (/i  )iV(<2)]  where  0 < < <2  < oo 


(3.35) 


(3.36) 


(3.37) 


Cov[/Y(/i)A'(/,2)]  = E[A'(/i)iV(<2)]  - E[iV(D)]E[fV(t2)] 
= E[A^{/i)A^(t2,)]  - M{U)M{h) 


(3..38) 


Substitutiirg  (3.37)  in  (3.36)  and  using  tlie  result  in  (3.38)  yields 

Cov[A'’(D  )A' (/2)]  = / in{u)M {I2  - v,)du  + I m(u)M [t\  - iL)du -\- M{t\) 

-M{U)M{l2) 

h 

m{u)[M(t2  - m)  + M(h  - n-)]dti  + M(<i)[l  - M(t2)](3.39) 

0 

An  expression  for  Var[A'(fi)]  can  iinmediatelly  be  obtained  by  setting  tj  = Thus, 


Var[vV(/i )]  = 2 / ;77(m)A/(/i  ~ u)du  + M(tx ) - M'^(ix ) 


(3.40) 


0 


This  result  verifies  expression  (3.37). 


We  now  use  expression  (3.36)  to  find  an  expression  for  the  expectation  of  the  product 
of  the  renewal  increments,  (0  < ri  < (2  < <3  < 00) 


E[(A(/2)- A(/i))(A(/3)- A(/2))] 


E[A’(/2)A'(/3)]  - E[A''^(/.2)]  - E[A'(/i)A'(/,3)]  + E[A(/,)vV(t2)] 
rn{ii)M{l2  - u)du  + (^2)]  + E[A  (/i)  _ 


0 


2 
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w E[NHt^)]  + E[N(h) 
m('u)M{t2  - u)du ^ ^ ' 


■^0  2 

'-'0  2 
^2  r ti 

m(  u)M (/3  - ~ 

0 -'o 

''  , ..r,.  E[A''^(<2)]  - E[iV(<2)] 

7?7 ( u ) M ( ts  - u )du ^ EiZL 1 

0 2 

M(/2  - u)du  + I ' m{  u)M(t3  - u)du  - ~ ^(^2)] 

“'0  -'ti 

Therefore,  substituting  (3.37)  in  (3.41)  we  obtain 

E[{N [t2)  - N [h)){N ih)  - N [h))\ 

^1  rt2 

M(/2  - u.)du  + / m(z/,)A/(/3  - u)du  - 

•"0 

h 

m(u)[M(ts  - u)  - M(t.2  - u)]du 
h 


2 


t-y 


m{u)M {t.2  - u)du 


0 


Additionally, 


E[A'(/,2)-  7V(ti)]E[A'(b3)-iV(to)] 


= M(/2)M(/3)  - hP{t2)  - M{h)M(t3)  + Miti)M{t2) 

t'2 

in(u)[M(i3)  - M(t2)]du 


h 


Combining  (3.42)  and  (3.43),  we  conclude  that 

Cov[7V(/2)  - N{ti),  N(l3)  - iV(/2)] 


h 


m(u)[M{t3  - u)  - M(t2  - u)  - A'Hts)  + M{t2)]du 


(3.41) 


(3.43) 


(3.44) 


which  is  the  required  result.  Additionally,  if  we  let 


Ti  = I 2 - t 


and 


T2  = I 3 - 1>  = (/  3 - C ) - 7-1 


expression  (3.44)  becomes 


Cov[Af(t2)  - jV(/i),iV(l3)  - A(/2)]  = 

m(  «)[A/(l]  + Ti  + T2  - u)  - 


+ Ti  — u)  — M(ti  + Ti  + ^2)  + M(/i  + Ti)]du 


ri 


0 


w,(ti  + v)IA/(ti  + T2  - c)  - M(ti  - v)  - M{ti  +Ti  + T2)  + M(h  + Ti)]dv  (3.45) 
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If  we  let  ti  OC’,  we  can  obtain  the  liiniting  behavior  of  this  covariance  expression; 

lim  Cov[.V(/,2)  - N(ti),  N(t3)  - A^(t2)] 


/ 1 — *-OC- 


rri 


= lini  / m(ti  + v)[M{ti  + T2  - v)  - M(ti  - v) 
— M(t\  + 7"i  + T2  ) + A/(/]  + Ti)]dv 

+ rj  - „)  - M{r,  - v)  - 

0 d // 

1 /’  r- 

— / [ M ( r-2  + u) ) - M( u) ) -] clw 

l-i  Jq  ft 


tl  - Ti 


]dv 


(3.46) 


We  can  see  that 


lim  Cov[7V(«2)  - iV(/i),iV(/3)  - A^(t2)]  = 0 
1 1 — 


for  arbitrary  values  of  ti  and  T2  only  when 


T2 


M ( t-2  + w ) - M ( w ) = 0 


or  equivalently, 


M ( T2  + u’ ) - M[  uj ) + 


II 


This  implies  that  the  renewal  function  M(-)  must  satisfy  the  relation: 


M{y)  = ^ 


y 

d 


which  is  true  only  for  the  l^oisson  process. 


Although  a differential  form  of  tlie  covariance  of  the  number  of  renewals  appears  in  the 
recent  text  by  Daley  and  Vere-.lones[l()],  it  is  not  amenable  to  useful  expressions.  Cohen[8] 
does  not  include  any  specific  treatment  on  the  covariance  of  the  number  of  renewals.  The 
quasi-closed  form  formulas  for  the  covariance  functions  just  obtained  appear  to  be  novel. 

3.5  Conclusion 


In  this  chapter  we  have  derived  the  Joint  probability  law  of  the  number  of  renewals  at 
three  time  epochs.  Hence  we  derived  the  joint  probability  law  of  the  renewal  increments  for 
both  the  time  dependent  and  the  steady  state.  A closed  form  expression  for  the  covariance 
function  of  the  renewal  increments  was  derived  and,  lienee,  it  was  shown  that  the  renewal 
increments  are  uncorrela.ted  only  for  the  case  when  the  inter-renewaJ  times  are  negative 
exponentially  distributed  i.e.  for  the  homogeneous  Poisson  process  in  which  case  they  are 
known  to  be  independent. 


CHAPTER  4 


THE  USE  OF  MULTIPLE  INTEGRALS  IN  THE  STUDY  OF  THE  ORDER 
STATISTICS  OF  THE  ORDINARY  RENEWAL  PROCESS 


l.i  lilt  rod  action 


The  distribution  ol  order  statistics  in  a homogeneous  Poisson  process  where  the  in- 
terarrival times  are  independent  and  identically  distributed  random  variables  obeying  the 
negative  exponential  distribution,  is  well-known  and  appears  in  a number  of  standard  ref- 
erences (see  e.g  Karlin  and  Taylor[25]).  For  example  it  is  proved  that  given  the  occurence 
ol  at  least  one  Poisson  event  in  the  interval  of  time  (O,0i  the  probability  of  the  occurence 
of  any  of  the  events  in  an  infinitessimal  interval  dO  is  <i  0 t.  In  other  words, 

the  order  statistics  of  the  waiting  times  are  ordered  sanijiles  from  a uniform  distribution. 
From  these  results,  the  distributions  of  order  statistics  are  easily  derived.  When  dealing 
with  an  ordinary  renewal  counting  process  {A(C  i t > 0}  where  the  inter- renewal  times  are 
independent  and  identically  distributed  random  variables  having  probability  density  func- 
tion  /(•)  and  distribution  function  /’’(•)  the  derivation  of  the  distribution  of  order  statistics 
has  proven  difficult  and  does  not  seem  to  have  appeared  so  far  in  the  literature.  The  dif- 
ficulty stems  Irom  two  facts,  first,  a.  direct  derivation  of  the  joint  distribution  of  waititng 
times  conditioned  on  A(/)  = ii  renewals  does  not  constitute  an  appropriate  approach  for 
the  derivation  of  the  distribution  of  order  statistics.  Rather,  one  has  to  use  and  rely  on 
the  joint  distribution  of  inter-renewal  times  and  the  number  of  renewals  to  arrive  at  the 
recjuired  results.  The  second  difliculty  stems  from  the  fact  that  the  analytic  derivation  of 
these  distributions  requires  the  reduction  of  multiple  integral  terms,  which  does  not  at  first 
seem  possible. 

However,  using  Theorem  1 of  Chapter  1,  we  use  the  multiple  integral  technique  to  derive 
joint  and  marginal  distributions  of  order  statistics  of  waiting  times  {WjJ  = 1,2, . . .}  of  an 
ordinary  renewal  process.  In  particular,  we  obtain  quasi-closed  form  expressions  for  the 
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distribution  of  the  niininiurn^  the  maximiim^  the  k-th  order  statistic  and  the  range.  Also, 
the  joint  distribution  lunction  of  two  order  statistics  and  the  n order  statistics  are  derived. 
For  each  of  the  derived  distributions,  the  results  are  used  to  recover  well-known  expressions 
in  the  special  case  of  the  Poisson  process. 

4.2  Distributions  of  Order  Statistics  of  Waiting  Times 

The  basis  of  the  present  derivations  is  the  joint  distribution  of  the  first  n inter-renewal 
times  Xi,  number  of  renewals  N[t)  or 


Pr{xi  < Ai  < x\  -f  a*2  < A^2  < ‘^‘2  + d.x*2, . . . , < A"^  < Xn  + dxn,  N{t)  — n] 


— /(^l)/(^^*2)  • • - F(t  - X[  - X-2  - • • • - dx2  . . .dx 


n 


(4.1) 


for  n = 1,2,....  f j‘om  this,  we  can  immediately  write  down  the  conditional  joint  probability 
density  function  of  the  fii'st  n inter-renewal  times  given  that  n (n  > 1)  renewals  have 
occurred,  i.e. 

Pr{xi  < A 1 < X[  + dx\ , X2  < A2  < 3*2  + d.x‘2, . . • , < An  < Xn  + dxn\N{t)  = n) 

_ Pr{xi  < A ] < x\  + r/.Ti,  X2  < A 2 < X2  + dx2, . . . , x^  < < x^  + dx^^ 

Pr{A(/)  = n} 

_ fi^l)f(X2)  • » •f(Xn)[\  - F(t  - X[  - X2  - » » • - Xn)]dXi  dx2  ■ > -dx^ 

7An)(/)  _ F(n+1)(^) 

For  notational  simplicity  let 


(4.2) 


Pr{A'(/)  = n)  = F^^^\t)  - F^^^^^\t)  = Pn[t) 

Expressing  equation  (4.2)  in  terms  oi  the  waiting  times  i — 1,2, .. . does  not  appear 

to  be  too  helpful.  For  exam|)le,  we  obtain  lor  the  joint  probability  density  function  of  the 
n waiting  times 

4>{WuW2,  ....  «’l  )/(  U’2  - W\  ) • ■■f{Wn  ~ «’n-l  )[l  ~ F(i  - w„)]  (4.3) 

If  we  can  integrate  this  ex])ression  we  can  obtain  the  marginal  conditional  distribution  of 
the  k-th  waiting  time  as  follows 


Pr{ll4.  < Wk\N{l)  = 11} 

2 /*  ^‘■’k  /•  1^2  r t 


• • • 


Fn{l  ) -'o  -'0  Wk  -'  w,,-! 

[1  - F(i  - U’n)]dWn  . . .dtVk+l  dull  . . .dwk 


f{  U>1  )/(  U’2  - Wi  )•••/(  Wn  - tVn-1  ) 


-1 
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The  reader  can  see  how  difficult  it  is  to  manipulate  this  integral  and  obtain  closed  form 
results.  However,  a])])lying  the  technique  of  multiple  integrals  we  can  immediately  obtain 
the  desired  results  in  a more  useful  form  using  the  expression  for  the  joint  distribution  of 
the  inter-renewal  times  and  the  number  of  renewals. 

In  each  case  we  identify  the  region  Tv  of  integration  of  the  following  integral: 


)/(-^*2)  • • •f(^7i)[^  - - Xi  - X‘2  - • • • - Xn)]dxi  (1X2  • • -dXn  (4.4) 


7^ 


4.3  The  Distribution  Function  of  the  First  Order  Statistic  (the  Minimum) 


We  want  to  find 


PrjlTi  < ;r|iV(/. ) = 


First  we  calculate 


1 1 = Pr{lTi  < X.  N[t)  - n] 


• • • 


/( )/( )•••/(  )[I  - F(t  - Xi  - X2  - • • • - Xn  )]dxi  (1x2  • • • dx 


n 


for  X < t and  where 


F — { X : 0 <C  .1*  1 ^ .T , 0 < .T 1 T .T  2 T • * • T 71  ^ } 

= {x  : 0 < 1 < x,  0 < .1*2  H + Xn  < t - } 


Thus  the  integral  becomes 


X 


h = / f{xi) 

0 


/( •<•'■2  )••■/(  -I'n  )[1  - F{t  - Xi  - X'2  X„  )]fix2  . . . (IXn  dX\ 


0<C:i’2 ^t—X\ 


And  using  Theorem  1 


r X rt  — x\ 

h=  f(x\)  / — F(t  - xi  - u)]du  dxi 

'F)  -^0 

/(X,  - X, ) - - X,  )]^/x, 

0 


(4.5) 


Therefore,  we  conclude  lhal, 


Pr{H',  < x|A'(/)  = n} 

( 1 

/ 0<x<i 

•/  n 

t < V < 00 


= { Pn(0-M, 

I 1, 


(4.6) 
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Example  6 The  Poisson  process 


As  an  example  we  investigate  the  case  when  the  inter-renewal  times  obey  the  negative 


exponential  distribution  with  parameter  A and  consequently  mean  inter-renewal  time  p = 
1/A.  We  remind  the  reader  that  this  is  the  special  case  of  the  Poisson  process.  For  the 
negative  exponential  distribution 


F{t)  = 1 /(/)  = Ae"^^^ 


and  for  the  Poisson  process 


Pr{A'(0  = n}  = 

/?.! 


Substituting  these  results  into  equation  (4.6)  we  obtain 


and,  of  course 


Pr{Mh  < .r|iV(/)  = ?i} 


X 


{Xty^e 


n^  — Xt 


Ac 


-Ar, 

1 /'/ 


n! 


1 


0 


dx  1 


(AO^e 


n^  — At 


/\  t 


n: 


0 


(n-  1)! 


dx 


- ((-  X ) 


n 


= 1 


/ X \ 

y l - - J , for  0 < X < t 


Pr{Hq  < .rjvAAO  — foi‘  t < x < oo 


AA The  Distribution  Function  of  the  /?,-th  Order  Statistic  (the  maximum) 


We  want  to  find 


< x\N(t)  - n} 


First  we  calculate 


In  = Pr{H  n < X,  N(  t)  = n] 


/(,Tl  )/(.T-2)  . . ./(.rn)[l  - F(t  - - .T2 


Xn  )]dxi  dX2  . . .dx 


n 


R 


for  X < / and  where 


7v  = { X : 0 < X 1 + a 


+ Xn  < X < t} 
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Thus  the  integral  becomes 


— I I — 'I  f{^l)f(^^2)---f(Xn)[l-F(t-Xi—X2  — Xn)]dXi  clX2  • > . dx^ 

And  using  Theorem  1 


In  = I r^^^Hu)[l  - F{t  - u)]du 
0 


Therefore,  we  conclude 

r 1 

Pr{H/„  < x\N(t)  = n}  = <j 

I P 

Example  7 The  Poisson  process 


X 


.r‘”)(«)[l  - F(t  - U)]du,  0<x  <t 


(4.7) 


t < X < oo 


Again  we  investigate  the  case  when  the  inter-renewal  times  obey  the  negative  exponential 
distribution.  Substituting  in  e(|iiation  (4.7)  we  obtain 


and  of  course 


Pr{H;,  < ,r|A^(/)  = n} 

1 


Jo  (h  -1)! 


e ^ e 


n\ 


1 


x'^ 


r X 


0 


mF  ^du 


= — , for  0 < X < t 

t.n 


Pr{Hy^  < .:r|/V(/)  = //}  = 1,  lor  / < x < >oo 


4.5  The  Distribution  Function  of  the  A:-th  Order  Statistic 


We  want  to  find 


PrilT/,  < x\N(t)  = ??.},  for  I < k < 


n 


First  we  calculate 


h = Pr{H4  < x,N{t)  = /^} 


/ ( X 1 )/( X ) )•.../(  Xj^  )[1  - F(  t - xi  - X2  - • • • - Xn  )]dxi  c/.i*2  . . . dx 


n 


n 


for  X < t and  where 


7^  = {x  : 0 < .'i;,  x^  < x,  0 < ,r„  < t} 

= {x  : 0 < .r  1 -f- (-  XI,  < X.  0 < .rr.+  | -|- 1-  ;r„  < t - ,7;,  - . . . - .t*.} 
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Thus  the  integral  becomes 


f{Xi)...f(Xh)  J J---J  f(Xk+i)...f(Xn) 

0<Xl  H \-X^^<X  0<X^^i  ^ [-Xn<t  — Xi X}; 

[1  — F(t  — 2*1  — X'2  — • • • — Xn)]dxi^^i  . . . dXn  dx\  . . . dxf^ 


And  using  Theorem  1 


h = 


X 


t — u 


^\v)[l  — F(t  — V — u)]dv  du 

0 *^0 


/X 

- u)  - - u)]du 

0 


Therefore,  we  conclude  for  1 < k < n that 


Pi'{MT  < 2|iV(/)  = n] 

= I cs)  r - »)  - »£-■<<  ,4.8) 

I T t < X < oo 


see  that  this  form ii la  also  holds  for  k = I and  k = n.  Although  we 
could  have  just  presented  one  proof,  nevertheless  we  gave  the  proofs  for  the  minimum  and 
the  maximum  to  provide  the  reader  with  a better  insight  to  the  problem. 

Example  8 The  Poisson  process 

Again  we  investigate  the  case  when  the  inter-renewal  times  obey  the  negative  exponential 
distribution.  Substituting  in  equation  (4.8)  we  obtain  for  0 < a*  < / 


Pr{Wr<x\N(t)  = n} 


(A0"e 


n c'  — \t 


n\ 


0 


(A--  !)! 


e 


( n -/>:)! 


du 


I 


X 


B[  /<■,  11  — l\'  1)  J Q t 

1 


t 


B(k,  n - k + 1 ) .; 


t ' t 
l - 'wY^~^dw 


0 


which  is  the  well  known  Beta  distribution.  01  course  for  / < x < oo 


Pr{HT  < 2|/V(/)  = 71 } rr  ] 
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4.6  Tlie  Distribution  Function  of  tlie  Range  of  the  Order  Statistics 


We  want  to  find 


•{M;!  - H’l  < x\N(t)  = n},  l < k < n 


First  we  calculate  for  x < t 


Ir  = Pr{W„  - I'Fi  < x,N(t)  — 7i} 


)/(•^•2)  • • • /(a;n)[l  - F{t  - xi  - X2 


Xn)]dXi  dX2  . ■ . dXn 


TZ 


where 


n 


= {x  : 0 < ,):2  + • • • + Xn  < X,  0 < .C]  + ,X'2  H + X„  < /.} 

= {x  : 0 < X,  < /.  0 < X2  + • • • + .C„  < .f,  0 < ,r2  + • • • + .r„  < t - Xi} 


Thus  the  integral  becomes 


//?  = 


/ J ■■■]  J{X2)  ■ ■ ■ f(Xn) 

<t,  0<JL’2H X’l  ] 

[1  - F(  / — 1 — x-2  — • • • - Xn  )]dx2  . . . dXn  dx\ 


(4.9) 


And  using  Theorem  1 


t—x 


X 


Ir  - 


- I^{t  - V - xi)]dv  dxi 

•MJ  ’^0 

+ / I - F{t  — xi  - u)]dudxi 

'F-x  ’^0 

/(.i-i)  / - F(t  - v-  x, 


u 


+ / -,r,  )-/■’>")(/ -xi)]da-i 

t-X 


Therefore  we  coiichide  for  1 < ii 


Pr{lF 


„ ITi  < x|/V(/)  = n} 

/ 1 /•  < — X 


1 


X 


Pnit). 


/(•i'l)  / /**"-*>( t>)[l-T(/-7;-.ri 


0 


0 


< 


+ 


1 


Fn{  f ) d t-x 


fi^i)[F^"-'Ht  - X, ) - - X,  )]dx, 


0 < X < t 


(4.10) 


1, 


t < X < oo 
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Example  9 The  Poisson  process 

Again  we  investigate  the  case  when  the  inter-renewal  times  obey  the  negative  exponential 
distribution.  Substituting  in  equation  (4.10)  we  obtain 


and  of  course 


Pr{fby^  — Wi  < o;|A(/)  = n} 


1 


t—x 


(AQ»e 


— Xt 


Xe 


, — ,\v 


00  \n  — 1^,71— 2 


A 


u 


n: 


0 


0 (n-2)! 


t 


+ / Xe 

■'  t-x 


(II -2)! 

[n  — 1).t’^“4  — [n  — 2)x^^ 


, for  0 < X < t 


Pr{Mqi  < ;r|A^(0  = = 1,  for  t < x < oo 

4.7  The  Joint  Distribution  Function  of  Two  Order  Statistics 


We  want  to  find  for  jiositive  integers  k < I < 


n 


< V,  I'O  < = n} 

We  consider  the  following  cases  for  the  joint  distribution  function  of  Wi^^Wi  and  N{t) 
1.  0<^<2T</<OC 

hi  - Pr{I4'^A’  < y,  Wi  < z.  N(t)  - 7?.} 


)f{^'2)  • • • - E(t  - Xi  - 2*2  - • • • - Xn)]dxi  (1x2  • • -dXn 


R 


where 


7^  = {x  : (X  2i  -f  • . . + 2/,.  < ^,  0 < 2i  + • • • + XI  < -,  0 < 2i  + • • • + Xn  < t} 
— {x  . 0 < 2]  4~  * • • + xr  < y^{)  “h  * * • “h  «r/  ^ z — (x\  + • • • -f  2^), 

0 < 2/^1  + • • • + Xn  ^ t — (X\  + • • • -f-  2/} 

Thus  the  integral  becomes 


I /•••/  /(‘^‘l).../(.^•/.)  J J 'J  /(2/,+  i).../(2/) 

0<xi  H \-x^<y  H 1-^'/  <~-(a’i  \-xy  ) 


f ) • • • /( ) 

0<X';^  1 H ["•i'n  ^t  — {x\  -j j-O.’/  ) 

[1  — F(t  — 2]  — 2*2  - • • • — Xj^  )]dx\  (1x2  • • • dx 


n 


(4.11) 
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And  using  Theorem  1 


ry 


' — u 


hi  - / r^^Hu)  / 

0 -^0 

t — u — v 

— F(  t — iL  — V — iu)](lw  dv  du 


0 


ry 


— u 


0 -^0 


[/?("  _ y _ pj  _ jr(n  — u — v)]dvdu 


(4.12) 


2.  0 < j/  < < < r < oc' 


Pi'{in-  < y,  W)  < iV(/)  = n}  = Pr{in-  < y,  N(t)  = n} 

- M)  - - u)]f/w  (4.13) 


■'  u 


0 < z < y < t < oo  or  {)  < z < I < y < 


oo 


Pr{H4-  < y,Wi  < z,j\{i.)  = 7i}  = Pr{IF,  < z,N(t)  = n} 

.r('>(tt)[F<”-')(l  - «)  - F‘"-'+i)(/  - iOldu  (4.14) 


0 


4.  0 < < < 7/  < s < 0C‘  or  0 < / < 5 < ;(/  < .oc' 


fc  < .?/« I'P/  < N{1)  = n} 


Pr{F(/)  = 

F<")(/.)  - F<”+‘)(/) 


(4.15) 


For  the  case  when  / = n we  consider  again  four  cases. 
1.  0 < y < z < t < oo 


4/  = Pr{H■/c<y,H•/<-^^'(/)  = /} 


/(•'-'i  ■ ■ •/(>r/)[l  - F(t  - ,Ti  - x-2  - • • • - ,c;)]f/,r]  dx2  . . .(/.'C;(4.16) 


7? 


where 


Tv  - {x  : 0 < ;ci  + • • • + ;i-/,  < y,  0 < .fj  H + xi  < z] 

= {x  : 0 < .1-1  + • • • + xk  <y^)<  Xk+i  + ---  + XI  < 5 - (.Ti  + • • • + .I'fc)}  (4.17) 


Thus  the  integral  becomes 


hi  = I / •••/  /(-^i  ) • . . /(-r/,. ) J j ) • • -/(^‘/) 

(J<x'i  H H H f-F/e) 

[1  - /’'(/  - xi  - X-2  - • • • - .T/)]c/:i*i  dx2 . . .dx/ 


(4.18) 
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And  using  Theorem  1 


y 


z — u 


hi  = / ^’^(u?)[l  — F{t  — V — u)]dvdu 

0 •-'o 


2.  0<y<t<z<oc 


Pr{in-  < y,  W,  < z,  N(t)  = 1}  = Pr{H  ^ < y,  N(t)  = /} 


u 


3.  0<2<j/<<<ooor0<^<^<?/<oo 


Pr{'n  < y,  IP/  < N(t  ) - 1}  = 


Pr{M'^/  < z,N{t)  = 1} 

I ^Hu)[l-  Fit- u)]du 

•J  / ^ 


4.  0 < i < ?/  < ^ < oc'  or  0 < / < ; < y < oc' 


Pr{lP/c  < yhVi  < ',.V(/)  = /} 


Fr{A^(/)  = /} 

t 

/*<'>(«)[!  - Fit  - u)]du 


0 


Therefore,  we  conclude  for  !</,:</<  n 

Pi’l'P'fc  < </,  H"/  < -|iV(/)  = '«} 

1 rv  ry-u 

} 'J  0 •>'o 

n-l) 


< 


- «-  V)-  1)(^  _ „ _ ,, 

^ ' .rP->(w)[F‘"-^->(/.  - u)  - F('^-A-+i)(, 

-^0 


ll 


0 < y < z < t < oo 


)](iu,  0<y<t<z<oo 


1 


Pn(^)  -^0 

I 1, 


/*«')(  - U)  - - u)]du, 


z < min{/,  ?/}  < oo 
t < min{?/,z}  < 00 


Note  that  the  case  when  k = / is  trivial. 


4.8  "J'he  .loint  Distribution  Function  of  the  n Order  Statistics 
We  want  to  find  for  u’|  < «>2  < . . . < (/?„  < t 

Pr{  ll|  < (C| . I4'2  < W’2,  • • . , H'n  < -Wn,  |N’ (f ) = n}, 

First  we  calculate 


lo  = Pr{4P]  < (Cl,  IF2  < n>2, . . . 11  „ ..  .Wn,  Nit)  = ??,}, 


/(•'■l  )fiX2)  ■ ■ •/(•fn)[l  - Fit  - .t'l  - ,1'2 


7? 


(4.19) 


(4.20) 


(4.21) 


(4.22) 


(4.23) 


• • • 


.x\j  )]dxi  (1x2  ‘ • - dxji 
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where 


^ — {x  . 0 <C  .T|  ^ W\  , 0 <C  .1*1  -f~  1‘2  ^ ^^'2')  • • • , 0 <C  1*1  “f"  1*2  4"  * ■ ’ “1“  *^n  ^ } 

= {x  : 0 < ,1*1  < U’l , 0 < 1*2  < 102  - 1 , . . . , 0 < l*n  < lOn  - Xi  - 1*2  - ...  - l*n-l  } 


Thus  the  integral  becomes 


lo  = 


•^1  /•it/2-^1  r Wn-Xy^-l-...-Xl 

/(a-|)  / f(X2)...  f(Xn) 

0 -^0  0 

[1  - F{t  - ,r,  - x-2  - • • • 


Xn)]dXn  ■ ■ .(1X2  d^l 


(4.24) 


Therefore,  we  conclude  III  at  for  0 < ici  < W2  < . . . iu„  < / 


Pr{  I'l'i  < iui,  IT2  < iU2, . . . , IT„  < w„|vY(t)  = 7?,} 

I /'“'l  j-W2-Xi  I’Wn-Xn-i-.-.-Xi 

= TTTTT  / ) / fi^2)  ■■■  f(Xn) 

^ n\i  } 0 -^0  -^0 

[1  — F(/  — X\  — I2  — • • • — Xn)]dXn  . . .(1X2 


(4.25) 


Taking  the  partial  derivative  with  resj)ect  to  u;i,  u’2, . . . we  obtain  the  conditional  joint 
probability  density  luiictioii  ol  the  ordei*  statistics  which  is  a result  ol  special  importance: 


0(  ? ^2  ? • • • ^ ) 
f{l0l)f{l02  - 10^).. 


)[l  F(t  — 10 n)] 


I 0 


Pn(t) 


0 < lOi  < W2  < . . . < Wn  ^^26) 
otherwise 


which  is  the  same  with  result  (4.3). 

Example  10  The  Poisson  process 

Here,  using  ecpiation  (4.26)  we  recover  the  well  known  result  for  the  Poisson  process 
with  parameter  A. 


d)(  to  u 102 , . . . Wn  ) = 

n! 


pi 


for  Wi  < W2  < ...  < ((>„  < / . 
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4.9  Conclusion 


In  this  chapter  we  have  presented  novel  results  on  marginal  and  joint  distribution  func- 
tions of  the  order  statistics  of  waiting  times  of  an  ordinary  renewal  process,  namely  the 
marginal  distribution  function  of  the  minimum,  the  maximum,  the  k-th  order  statistic,  the 
range,  the  joint  distribution  function  of  any  two  order  statistics  and  the  joint  distribution 
function  of  all  order  statistics  (see  Gakis  and  Sivazlian[15] ). 


CHAPTER  5 

EXTENSIONS  OE  THE  RENEWAL  PROCESS 


5.1  Introduction 


We  first  define  the  filtered  renewal  process: 

Definition.  A stochastic  process  {A  (/),/  > 0}  is  said  to  be  a fUtered  renewal  process  if 


it  can  be  represented  by 


iV(0 


A'(/)  = ^ 


7M=:1 


— /'(C  H i,  1 1 ) + r(/.,  IL2, 1 2)  + • • • + 7'(/,  ITyV(t),  yyv(i)) 


(5.1) 


where 


1.  > 0}  is  a renewal  counting  process; 

2-  = E 2, . . .}  is  a,  secjiience  of  inde|)endently  and  identically  distributed  random 

variables,  independent  of  {A'(/),/  > 0}; 


3.  {HEi,  m = 


1,2,...}  is  a sequence  of  waiting  times  of  the  renewal  counting  process 


4.  y)  is  a real  valued  lunction  of  tliree  variables  and  is  called  the  response  function. 

Sivazlian[3 / ] piesents  a result  for  the  characteristic  function  of  the  filtered  renewal  pro- 
cess which  we  repeat  here 


(5.2) 


Conditioning  on  the  number  of  renewals 


^ = n]  Pr{A^(7)  = n} 


n=U 


G6 


(5.3) 
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If  N(t)  — 0 then  A (t)  = 0 and  E[c-'^'^ A"(t)  = 0]  = 1.  Thus,  (5.3)  can  be  written 


OO 


E[ei^A'(0]  = p,.{/V(/)  = 1)  + ^ = '«]Pr{A^(t)  = n} 


n=0 


<yz> 


= F^t)  + J2  I J---J  /(.i-i)E[e‘^"<*’^'’''')]/(x2)E[e‘'^"(*’^'+^2,K2)] 

n=\  0<Xi-^X2-\---\-Xn<t 

. . ./(,r„)E[e'"'-('’"-'+-2+-+x-„,i„)]EC(^  -XI-X2 .r„)c/.Ti  dx2  ...dx^ 

(5.4) 

where  F^{-)  is  the  coiiipleinentary  distribution  function  of  the  inter-renewal  times.  If  we 


define 


'h((T,/)  = E[c‘‘"-’'4P]  and  E{a,t,x)  = 


(5.5) 


Then  clearly,  the  integral  (5.4)  lias  the  Ibrni; 


n 


’^(a,t) = f^f+yi  j j "■]  n 

7i=l  |-.E,j  </  ./=•  ^ 


'-vF/i-rj) 

l=i 


n 


n 


FFt-Y  .ibin  (5-6) 

3 = \ ./  = 1 


Ihe  general  argument  used  so  far  to  obtain  the  characteristic  function  of  the  filtered  renewal 
process  does  not  result  in  a manageable  solution. 

However,  by  restricting  the  form  of  the  response  function  to  make  it  a function  of  the 
difference  t — H\-,  additional  results  can  l)e  obtained.  It  should  be  noted  however  that  the 
forthcoming  results  apply  to  a more  general  class  of  response  processes. 

5-2 Background  Matei'ial  ajid  Definition  of  the  Exteiided  Compound  Renewal  Process 

A popular  class  of  stochastic  j)rocesses  that  appears  in  the  study  of  many  problems  in 
science  and  engineering  is  that  of  the  compound  point  process  defined  as 

/s 

A (/)  = }qi  + 1q2  + • • • + 

where  {Yoi,i  - 1,2,...}  is  a secpience  of  independently  and  identically  distributed  random 
variables  and  {A  (/),/  > 0}  is  a point  j)rocess.  The  compound  point  process  is,  thus,  a 
sum  of  a random  number  of  independejitly  and  identically  distributed  random  variables. 
An  extension  of  the  comj)ound  point  process  that  appears  in  the  literature  is  the  compound 


A ( / ) — V]  ( / ) + ^ 2(i)  * • • + h ,v(i)( / ) 


stream  defined  as 


68 


where  {Yi{t)^t  > 0,  i — 1,2,...}  is  now  a sequence  of  independently  and  identically  dis- 
tributed stochastic  processes  \w\th  common  crrigin  at  time  0 (see  e.g.  B.  V.  Gnedenko  and 
I.  N.  Kovalenko[18] ). 

A natural  extension  of  the  compound  stream  would  be  to  allow  the  origin  of  the  com- 
pounded stochastic  ])rocesses  to  be  random  and  uncommon.  In  this  paper  we  examine  the 
case  when  the  number  ol  tlie  compounded  stochastic  processes  and  their  origin  is  determined 
by  an  underlying  ordinary  renewal  process. 

First  we  define  the  notion  of  the  extended  compound  renewal  process  as  follows  A 
stochastic  process  {A(/),/  > 0}  is  said  to  be  an  extended,  compound  renewal  process  \i  \t 
can  be  represented  l)y 

;V(0 

A'(/)  = 

77i=l 

= ) \ {t  — if  1 ) + V2(/  — He)  + . . . + (5.7) 


where 


1.  {^(/),/>o)  is  an  ordinary  renewal  process  with  renewal  density  function  m(-)  and 
a finite  mean  inter- renewal  time  //; 

2.  {y„^(a*),.7:  > 0,  ni  = 1,2,...)  is  a sequence  of  independently  and  identically  dis- 
tributed stochastic  processes,  independent  of  {N(t),t  > 0}  with  known  statistical 
characterization;  they  are  called  the  response  proe:esses\ 

3.  {W^}  is  a sequence  of  waiting  times  defined  as  follows 


W yji  — A 1 + A 2 + . . . + A 
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where  {A  ^,  / — 1.2,...,  /??  } are  the  i liter- renewal  times  of  the  ordinary  renewal  process 

The  notion  of  the  extended  compound  renewal  process  is  a generalization  of  the  notion  of 
the  filtered  Poisson  process  in  the  extended  sense  as  defined  by  Parzen[31]  in  which  the  un- 
derlying process  is  assumed  to  be  an  oidinciry  renewal  process  rather  than  an  homogeneous 
Poisson  process. 
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We  would  like  to  underscore  here  that  although  {ymla:),  x > 0,  m = 1,2,...,  N(t)},  is  a 
sequence  of  mutually  iude])endent  and  identically  distributed  stochastic  processes,  {Yfn{t  — 
Wm),t  rn  — 1 , A^(/)},  is  a sequence  of  strongly  dependent  stochastic  processes, 

lliis  dependence  makes  the  study  oi  the  statistical  properties  and  behavior  of  the  extended 
compound  renewal  process  directly  from  (5.7)  prohibit! velly  difficult. 

Here  we  derive  a second  type  Volterra  integral  equation  for  the  characteristic  function 
of  the  extended  compound  renewal  process  (Section  5.3).  We  solve  this  integral  equation 
for  three  special  cases  and  we  discuss  the  solution  of  the  equation  for  a more  general  class  of 
underlying  renewal  processes  (Section  5.4).  We  also  obtain  a closed  form  expression  for  the 
first  moment,  and  dei'ive  a.  recursive  relationship  lor  the  higher  ordei*  raw  moments  (Section 
5.5).  Moreover,  we  demonstrate  how  the  GJ-^  /G/oc  queue  can  be  studied  as  a special  case 
of  the  extended  compound  renewal  |)rocess.  In  particular,  we  recover  Liu’s  et  al.[27]  result 
for  the  expected  number  ol  busy  channels  in  the  GG^  j G / oo  queue.  Additionally,  we  discuss 
the  queue  output  and  the  total  backlog  for  the  G / G / oo  queue.  And,  finally,  we  give  an 
economic  example  from  telephone  traffic  (Section  5.6). 

5.3  The  (_■  haracteristic  Function  o(  the  Extended  Compound  Renewal  Process 
The  characteristic  function  ol  a.  compound  renewal  process  is  the  following  quantity 


(5.8) 


where  without  loss  of  generality  the  sul)script  in  is  dropped  from 


Clearly,  for  N[t)  — 0 


Using  /(•),  F(-)  and  to  denote  respectively  the  probability  density  function,  the 

distribution  function  and  the  com j)lementary  distri l)ution  function  of  tlie  inter-renewal  times 
and  conditioning  on  tlie  waiting  time  of  the  first  renewal,  we  get 


E[e--V(q]  ^ > t}+  = x]f{x)dx 

= FHl)+  I ‘ = x]  f(x)dx 


u 


0 
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t 


- F^{t)+  I E[e 

0 


?\JcrY{t-X 


= F^{t)  + /(/,)  * {E[e‘'"''(‘)]E[e''’ -''<'>]} 


(5.9) 


So,  defining 

E[e>A'(()]  ^ and  E[e‘"'^’<*)]  = E(a,t)  (5.10) 

the  characteristic  function  of  the  compound  renewal  process  of  the  type  specified  by  (5.7) 
can  be  found  as  the  solution  of  an  integral  equation  of  the  following  type. 


^(a,/)  = F^(/) + /(/)*  [E(a,/)^(a,/)] 


(5.11) 


This  is  known  to  be  a second  type  Volterra  integral  equation.  Volterra  type  integral  equa- 
tions are  known  to  appear  fre(iuently  in  the  study  of  stochastic  processes  (e.g.  see  Tsokos 
and  Padgett[41],  and  Ilromadkaand  Whitley [22] ).  A closed  form  expression  for  the  solution 
of  this  type  of  equations  does  not  seem  to  have  been  determined  yet.  However,  for  certain 
classes  of  inter-renewal  time  distributions  closed  form  solutions  mav  be  obtained.  Moreover, 
from  equation  (5.1  1)  we  can  obtain  renewal  tyj)e  equations  foi*  the  higher  moments  of  the 
extended  compound  renewal  process  in  terms  of  the  lower  moments,  assuming  that  ¥(•) 
has  finite  moments. 

We  would  like  to  comment  hei*e  that  the  results  of  this  paper  can  be  extended  for  mixed 
distributions  for  inter-renewal  times  if  we  write  the  integral  in  equation  (5.11)  as  a Stieltjes 
integral. 

A brief  note  on  integral  equations.  Integral  equations  frequently  arise  in  the  study  of 
the  behavior  of  random  varial)les  and  stochastic  processes.  A special  case  of  Volterra  inte- 
gral equation  is  the  renewal  ecjnation.  Liu,  Ka.shyap  and  Temi)leton[27],  showed  that  the 
generating  function  ol  the  system  size  of  a queue  is  the  solution  of  a second 

type  Volterra  integral  equation  and  lienee  they  derived  a recursive  relationship  for  the  bino- 
mial moments.  The  same  approach  was  applied  by  Liu  and  Templeton[28]  in  the  study  of 
the  GR^^IGn/oo  cpieiie.  Our  methodology  does  not  restrict  itself  to  discrete  processes  of 
which  the  process  of  Liu  et  al.[27]  is  a very  special  case.  It  is  applicable  to  both  continuous 
and  discrete  processes  recpiiring  the  use  o(  characteristic  functions  rather  than  generating 


functions. 
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5.4  Special  Cases 

5.4.1  Negative  Expoiieiitially  and  Erlang- Distributed  Inter- renewal  Times 

We  now  examine  tiie  case  when  the  inter- renewal  times  are  negative  exponentially  dis- 
tributed i.e.  the  underlying  renewal  process  is  a homogeneous  Poisson  process  so  that  for 
A > 0,  0 < ^ < oc> 


f(t)  = Xe 


-xt 


and 


Xt 


The  Volterra  type  eciuation  can  be  written  in  this  case  as 


vl/(rr,  / ) c '^^4-  / Ac  {a,  x)dx 

0 


(5.12) 


which  yields  after  trans{)osing 


-Xt 


0 


(5.13) 


Taking  the  derivative  with  respect  to  / on  both  sides  of  (5.12)  we  obtain 


= — Ac  ' — A / Ac  ^^ii((J,x)^(a,x)dx  + Xz.(a,l)^(a,t) 


dt 


0 


(5.14) 


And  substituting  the  expression  lor  the  integral  (5.13)  into  (5.14)  we  obtain 


c/4^((j,  / ) 

Jt 


= + XtE{a,t)^{a,t) 

= -X'li{a.l)[\  - E(a,t)] 


M 


(5.15) 


Hence 


d^{aj.)  ^ 

= -All  -;( <,,()]</( 

Taking  into  account  the  initial  condition  'k(<7,  0)  = 1,  equation  (5.16)  yields 


(5.16) 


(5.17) 


This  result  appears  in  Parzeu[31]  in  his  study  of  tlie  filtered  Poisson  process  (in  the  extended 
sense). 
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For  Eiiang-2  distributed  inter- renewal  times  it  can  be  shown  that  equation  (5.11)  can 
be  reduced  to  a second  order  linear  ordinary  differential  equation  of  the  following  form: 

ct^  cl 

^'P(a,0  + 2A— $(ct,0  + A2[1  -E(a,t)]^{a,t)  = 0 (5.18) 

For  arbitrary  the  general  solution  of  equation  (5.18)  does  not  seem  to  fall  into  one 

of  the  classical  categories  appearing  in  the  literature  (see  e.g.  Ince[23]  and  Pearson[32]). 
However,  for  specific  fonns  of  the  response  processes  E{a,t),  solutions  may  be  obtainable 
using  one  of  the  standard  methods. 


In  general,  for  Erlang-A:  distributed  inter-renewal  times,  k = 1, 2, ...  it  can  be  shown  that 


(5.11)  can  be  reduced  to  a k-i\\  order  linear  ordinary  difFerential  equation  of  the  following 


form: 


dt 


k 


-f  A I ^(a,  / ) - X^E(a,t)^(a,  / ) = 0 


(5.19) 


5.4.2  Uniformly  Distributed  Inter-renewal  Times 


We  now  investigate  tlie  case  of  inter- renewal  times  that  are  uniformly  distributed  over 
[0,  a]  so  that  for  a >(),()</<  oc 


/(/)  = 


l/a  for  0 < / < a 
0 otherwise 


and 

( 1 for  - 00  < / < 0 

^ 1 — t/a  for  0 < / < ft 
f 0 otherwise 

The  Volterra  type  equation  (5.11)  can  be  written  for  0 < / < ft 

/ 1 /■  ^ 

^((7,/)=:  1 1 — / E(a^x)'if(a,x)dx 


ft  ft 


0 


Taking  the  derivative  with  respect  to  / on  both  sides  of  (5.20)  we  obtain 

(It  ft  ft 


(5.20) 


(5.21) 


The  initial  condition  is 


The  solution  to  (5.21)  is  then 


I ) = [i  _ 1 l\z 

ft  J 


dx 


0 


(5.22) 
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For  t = ka  + {)  < T < k = 1,2,...  the  Volterra  type  equation  can  be  written 


^(a, /)=:-  / x)"if(a^x)dx 


Taking  the  derivative  with  respect  to  t on  both  sides  of  (5.23)  we  obtain 

— ^(a,/)  = -E(a,  f)vp((j,t)  - -E((7,t  - a)^(a,t-  a) 

at  a a 


Define 


= ^(a,  r)  and  (^o(a,r)  = E((j,  r) 


and  let  for  k — 1,2,... 


0A.(cr,  r)  = 'if(a,ka  + r) 


and 


(,k(a,T)  = E(a,ka  + r) 


Using  these  quantities  into  (5.24)  we  obtain 


dr 


The  initial  condition  is 


d.  I 1 

(a,  r )^/,_i(a,  r) 

a a 


0a(^,  0)  = y;/,._i(a,a),  k=  1,2,... 


The  solution  to  (5.25)  is  then 


(5.23) 


(5.24) 


(5.25) 


L a Jq 


(5.26) 


The  solution  is  thus  obtained  recursively. 

5.4.3  The  Compound  Renewal  Process 

Another  case  in  whicli  equation  (5.11)  has  a readily  obtainable  solution  is  when  the 
response  process  does  not  depend  on  t \ .q.  E((t,  / ) = E(ct).  This  is  the  case  for  the  compound 
renewal  process  defined  as 


A ( / ) — > 01  + > 02  + . . . + >1 


oyv(0 


(see  also  discussion  in  Section  5.2).  Then 


:i(a)  = E[e 
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In  this  case  equation  (5.11)  reduces  to  a renewal  equation,  which  is  a Volterra  equation  of 
the  convolution  type, 

4'(ct,0  = F^(t)  + E{a)[f{t)*'li(a,t)]  (5.27) 

By  taking  the  Laplace  transform  (assuming  their  existence)  on  both  sides  of  (5.27)  with 
respect  to  t we  obtain 


£{4'(a,/)}  = £{F^'(/)}  +E(a)Z:{/(0}r.{4'(>7,0} 


Solving  for  £{'P(ct, /,)} 


C{'^((Tj)}  = 


C{F^t)} 


1-E((t  )£{/(/,)} 


•s[l  - -(a)C{f(l)}] 


s 


[l  + E{a)C{f(l)]  + ^H<r)C{f{t)y^  + ---] 


Inverting 


= 1 - F(/)  + -(ct)  / [1  - fit  - x)]J(x)dx  + E'^(a)  / [1  - f(t  - x)]r^^^x)dx  + 

0 -'o 


or  equivalently 


^(a,  t)  = 1 + [1  - -((T )]/'(/)  + -(^T)[l  - ::((t)]F<'^)(F  + E'^((t)[1  - E((t)]F(2>(F  + • • • (5.28) 
5.4.4  The  First  Moment  of  the  Extended  Compound  Renewal  Process 


We  know  that 


da 


= iE[-Y(/)] 


(5.29) 


cr=0 


and 


|r[g>A'(0- 


= 1 


(T=0 


Thus,  taking  partial  derivatives  with  respect  to  a on  both  sides  of  (5.9)  we  obtain 


da 


= 0+  l\f(x)  ^ 

‘h) 

0 


da 


' oa  da 


■^0 


— X 


dx  (5.30) 
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Let  (7  = 0.  Then  using  (5.29)  we  obtain 


f{x)E[.\ (t-x )]dx  + / /( .r )E[y ( t - X )]dx 


E[A'(t)]  = 

= /(t)*E[A'(t)]  + /(t)*E[y(/)] 


(5.31) 


Taking  the  Laplace  transfonn  with  respect  to  t on  both  sides  of  (5.31)  we  obtain 


£{E[A'(0]}  = C{f{t)}C{E[X(t)]}  + C{f(t)}/:{E[Y{t}]} 


(5.32) 


Solving  (5.32)  with  respect  to  E{E[A'(/)]}  we  obtain 

£{K[.V(I))}  = £(E|1-(()1) 

We  know  that  an  expression  for  the  renewal  density  function  m{-)  is  given  by 


C{rn(t)} 


1 - 


Thus  substituting  (5.34)  into  (5.33)  we  obtain 


(5.33) 


(5.34) 


£{E[.\-(/)]}  = E{m(/.)}r,{E[y(/,)]} 


(5.35) 


And  inverting 


E[A(/)]  = / nd.x')E[k'(^  — 
■'a 


(5..36) 


If  E[y(t)]  is  a Smith’s  function  then  using  Smith’s  key  renewal  theorem  we  can  determine 


the  limit  of  the  ex|)ectation  of  the  extended  compound  renewal  process: 


lim  E[X{t)]  = - I E[y(.r)lr/;r 

(-'X.  fl 


(5.37) 


5.4.5  Higher  Order  Momeiils  of  the  Extended  Compound  Renewal  Process 


Similarly,  we  can  ol)taiii  liiglier  order  raw  moments,  taking  into  account  that 


OCT^ 


(5.38) 


<7=0 


Thus,  assuming  that  V (•)  has  finite  moments  and  taking  the  k — th  derivative  on  both  sides 


of  (5.9)  we  obtain 


dcT^ 


<7=0  ' 0 


dx 


<7=0 


0 


/•=0 


dcT^ 


(5.39) 


<7=0 
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Therefore,  using  (5.38)  we  obtain 

/•  t ^ 

E[A'^-(0]  = / f{x)J2  (r)  - x)]E[X^-^t  - x)]dx 

r=0 

t ^ I't 

/(x)E[A'^’(/  - x)]dx  + (*:)  / /(x)E[y^’-(/  - x)]E[A''‘-’-(/  - x)]dx 

'^0 


0 


7’=1 


m * E[x^(t)]  + Y (^:)  /(O  * {E[r’'(0]E[.Y'‘-’-(/)]} 


(5.40) 


7’  = 1 


Equation  (5.40)  is  a renewal  type  integral  equation.  It  can  be  solved  similarly  to  (5.31)  by 


taking  its  Laplace  transform 


k 


£{E[A^-(0]}  = C{f{t)}C{E[X^(t)]}  + ^ (}•;)  E{/(/)}£{E[r^(/)]E[A^-’-(0]}  (5.41) 


7’  = 1 


Solving  (5.41)  with  re.s|)ect  to  E{E[.Y^'(/)]},  we  obtain 

£{E[.Y '•(/,)]}  = V-Ej/l!)}  E (.^)r.{E[E''(/.)]E[.Y^-’-(<)]} 

^ 7’=1 

Inverting  (5.42)  we  obtain  E[.\  ^(/)]  in  terms  of  the  lower  moments  as 

^ i-t 

E[.Y'‘-(/.)]  = ^ (*:)  / m(.x)E[y’-(t  - .r)]E[.Y^-'-(t  - x)]dx 

,=i 


(5.42) 


(5.43) 


If  E[y*^(t)]E[A  '(/)]  is  a.  Smith's  function  then  using  Smith’s  key  renewal  theorem  we  can 

determine  the  limit  of  the  A‘-th  raw  moment  of  the  extended  compound  renewal  process 
based  on  the  time  dependent  lower  moments: 


1 


'■X< 


lim  E[.Y^-(/.)]  = - (,[:)  / E[y'-(.x)]E[.Y^'-’'(.T)]fte 


(5.44) 


r = l 


Note  that  for  A:  = 1 we  recover  the  result  lor  the  first  moment. 

5.5  Applications 

The  extended  compound  renewal  process  can  be  used  to  generalize  existing  results  for 
specific  applications  of  the  filtered  Poisson  ])rocess.  Here,  we  present  four  examples  of 
potential  applications  to  operations  research. 

Application  1.  The  Expected  Number  of  Busy  Channels  in  the  GI‘^  /G / oo  Queue 

Formula  (5.36)  can  be  used  to  derive  the  expectation  of  the  number  of  busy  channels 
in  the  infinite  server  /G/oo  (pieue  with  random  batch  arrivals.  The  GI^ /G/oo  queue 
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can  be  considered  a special  case  ol  the  extended  renewal  compound  process  whose  response 


process  is 


B 


(5.45) 


^'(^)  = ^ HSj  > t) 
i=i 

where,  B is  a discrete  raiulom  variable  that  represents  the  size  of  a batch  arrival,  and 


Sj  is  a sequence  of  nonnegative  independent  and  identically  distributed  random  variables, 
independent  of  B,  with  distribution  function  $(•)  and  complementary  distribution  function 
representing  the  service  time  of  the  j-th  unit  of  the  batch.  I{  • ) is  an  indicator  function 


defined  as  follows 


I(Sj  > t)  = 


1,  if  Sj  > T 
0.  otherwise 


Here,  as  an  application  of  the  formulas  foi'  the  extended  compound  renewal  process  we 
obtain  the  expected  numl)er  of  busy  channels  in  the  G'/'^/G'/oo  queue.  Clearly  Y{t)  is  a 
simple  compound  process  with  expectation 

E[V'(r)]  = E[/i]E[/(,S'>  r)] 

= E[f/]Pr{5>r} 


= E[/i][l-<D(r)] 

= E[B]<^^t) 


(5.46) 


where  without  loss  of  generality  the  subscript  for  the  service  times  has  been  dropped, 
Substituting  (5.46)  into  (5.;16)  we  obtain 


E[A'(/,)]  = E[74]  / - x)dx 


0 


(5.47) 


and 


,.  prvoM  w E[71]E[,S'] 

bin  E[.\(/)  = — ^ / ^'^{x)dx  = — ^ ^ ^ 


0 d 

To  obtain  the  Volterra  ecpiation  for  the  characteristic  function  of  A (t),  we  note  that 


(5.48) 


OC' 


E((t,  /) 


E[c‘'^'"E)|/?  = b]  Pr{  fl  = /;} 

6=1 


<>c- 


6=1 

<yz> 


= Z Er{77  = 5} 


6=1 


(5.49) 
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The  probability  generating  function  of  IJ  is  defined  for  U < 1 as 


<yc‘ 


Gsiz)  = ^ = b} 

6=1 


Also 


P[^>/(5>«)]  = ^ = 1 - (1  - )$"(/) 


Substituting  (5.50)  and  (5.51)  into  (5.49),  we  obtain 


(5.50) 


(5.51) 


^aG)  = Gs  [1  -(1 


e‘'")4>'-'(i!)] 


(5.52) 


Hence  the  resulting  integral  equation  lor  the  characteristic  function  is 


'h((T,/)  = f'Gt)  + /(/)*  [1  - (1  - e‘")<l>^(4)]  4'(a,<)} 


(5.53) 


Note  that  this  e(|nation  for  4'((t. /)  is  defined  in  terms  ol  the  distribution  of  the  inter-arrival 
times,  the  probability  generating  function  of  the  batch  size  and  the  distribution  of  the 
service  time  for  each  batch  unit. 

Using  (5.43)  and  (5.44)  one  can  recursively  obtain  the  higher  moments  from  the  lower 

# 

order  moments  ol  the  simple  comjionnd  jirocess  defined  by  (5.45).  We  would  like  to  under- 
score that  unlike  Liu  et  al.[27]  who  provided  a recursive  relation  for  the  binornial  moments, 
our  methodology  determines  a recursive  relation  for  the  more  genercvl  raw  moments  of  the 
system  size  A(/).  Moreover,  the  methodology  of  Liu  et  aL[27]  is  restricted  to  discrete 
stochastic  processes,  while  the  present  methodology  can  cover  both  discrete  and  continuous 
stochastic  processes,  for  the  more  traditional  approach  to  (jueueing  problems  with  batch 
arrivals  the  reader  is  referee!  to  Chaudhry  and  Templeton[7]. 

5.5.2  Application  2.  The  Qiitmit  Rate  of  the  GI^ /G/  00  Queue 

The  output  Aq(/)  of  the  GI^  jG / oc  can  be  described  by  an  extended  compound  renewal 
process  whose  response  pi'ocess  -using  the  same  notation  as  that  of  the  previous  subsection- 


is 


We  note  in  particular  tliat 


B 

'o(^)  = < t) 

j=i 

N(t) 

A'o(/  ) = E - A'(U 

Z = 1 


(5.54) 


(5.55) 
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and 


E[A'o(/)]  = E[i:?]E[dV(/)]-E[X(/)] 


(5.56) 


Thus,  E[Ao(/)]  would  lollow  from  (5.55)  and  (5.56).  However,  expressions  for  the  higher 
order  moments  of  Aq(/)  and  for  its  characteristic  function,  could  not  have  been  readily 
obtained  from  (5.55)  because  of  the  correlation  of  N{t)  and  A'(/).  The  use  of  the  concept 
of  extended  compound  renewal  process  as  described  in  the  present  paper  obviates  these 
difficulties. 

An  expression  lor  E[Aq(/)]  is  obtained  alternatively  as  follows:  again  Yo(t)  is  a simple 
compound  process  with  ex])ected  value 


E[yo(r)]  = E[B]E[I{S<t)] 


Pr{.S’  < r} 


E[7J]<h(r) 


(5.57) 


The  expected  output  becomes  then 


E[A'o(/)]  = E[/y]  / ni(x)<^{t  - x)dx 


(5.58) 


•^0 


Assuming  that  .S  lias  a j^robability  density  function  </>(*)^  the  output  rate  can  be  obtained 
as  follows 


d 

Jt 


E[A'u(/)]  = - x)dx 

(it  .7q 

d 


E[B]  I m{x)—<i>(t  - x)dx  + [in(x)<l^(t  - 


u 


E[/y]  / ni{x)(l)(t  — x)dx 

•A) 


From  Smith’s  key  renewal  theorem 


(It  p 


0 


which  not  surprisingly  equals  the  input  rate. 


(5.59) 


(5.60) 


Using  the  same  |)iocedure  as  iu  suirsectiou  5.6.1,  the  ecpiation  for  the  characteristic 
function  of  A'o(/)  is  given  by 


4/((t,/)  = F^{i)  + fit)  ♦ {G's  [l  - (1  - )$(<)]  1'(c7,<)} 


(5.61) 
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5.5.3  Application  3.  The  Total  Backlog  in  a IG/oc  Queue 


The  total  backlog  in  a /(j/oo  queue  is  the  total  remaining  service  time  that  corre- 
sponds to  the  units  currently  in  the  system.  It  can  be  described  by  an  extended  compound 
renewal  process-using  the  same  assumptions  and  notations  as  previously-with  response 


process: 


B 


Y(t)  = Y.Ut) 


i—\ 


where  after  dropping  the  subscript  /,  the  functions  RiG)  are  defined  as 


R[t)^ 


S — T for  0 < r < S 
0 for  S < T < oo 


Also 


oo 


E[V'(r)]  = E[/?]E[/?(r)]  = E[B]  / {y  ~ T)d<i>{y) 


(5.62) 


Therefore 


E[A(/)]-  E[//]  / w(.r)  I [y  - (1  - x)]d<i>(y)dx 


0 


t—X 


From  Smith’s  key  renewal  theorem 


(5.6.3) 


lim  E[.V(/)j 


E\B 


r oc> 


k '^0  •'  X 

E[B] 


(y  - x)d<b{  y)dx 


( y — x)dx  d<^(  y) 


•^0  -^0 


E[yi] 


E[/y] 


It.  u 

E[/i]E[,S'^] 

2//, 


{ y - . < -•) 

2 


X.  2 

^d<i>(y) 


.\2-\^=y 


dd^iy) 


■'  .r=U 


(5.64) 


The  Volterra  equation  loi*  the  characteristic  function  can  be  found  by  using  the  same  pro- 
cedure as  in  subsection  5.6.1: 


5'(rT,/.)  = /.'^(/)  + /(/)  J 6’ 


B 


•yz‘ 


(1 


)d<P{y) 


(5.65) 


5.5.4 Application  4.  iotal  E.xpected  Iteveiuie  from  Long  Distance  IPhone  Calls 

The  revenue  from  a long  distance  phone  call  is,  usually,  a I'linction  of  the  duration  of  the 


conversation.  Here  we  assume  that  for  a conversation  that  started  at  time  0,  the  revenue 
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from  that  phone  call  at  time  r is: 


r(r,  5) 


or  for  0 < r < .S' 
a, S'  for  S < T < oc 


where  S is  a nonnegative  random  variable  which  represents  the  duration  of  a conversation, 
with  distribution  lunction  $(•)  and  complementary  distribution  function  Then 


oo 


E[r(r,.S')] 


r{T,y)d^{y) 


0 


CO 


ayd<^{y)+  / ard^iy) 


= a / yd<i>[y)  cxT<i>'^(T) 
0 


(5.66) 


Assuming  that  the  arrival  |)rocess  of  long  distance  phone  calls  is  an  ordinary  renewal  process, 
then  the  total  revenue  A(/)  is  an  extended  compound  renewal  process  whose  response 


process  is 


V(r)  = r(r,  .S') 


Therefore,  the  total  revenue  A(/)  can  be  written  as 

N{i] 

■V(/)=  E r(t-W,,S,) 

J = l 

where  the  random  variable  Sj  represents  the  duration  of  the  j-th  conversation.  Clearly,  the 
total  expected  revenue  at  time  t is 


E[A  ( / )]=  tn{ .7;  )E[/-(  / — :r , .S'  )]d,7: 

m(  X ) ( o / yd<^(y ) + a(  / - .t  / - x)}  dx 


0 


0 


(5.67) 


Intuitively  we  expect  that  the  expected  revenue  will  grow  infinitely  large  as  / — > oo  and, 

thus,  we  do  not  investigate  the  limiting  case.  It  may  be  interesting,  however,  to  investigate 
another  measure,  the  revenue  rate  defined  as  follows 


f(t) 


d r 

-E[A-I0l 


d 

Jt 


t-X 


in{  X ) ( o 


yd<l>{y)  + a{t  - x)V(t  - x)  > dx 


0 


' d 

in(x)a  — 

0 <lt 


u 

t — x 


(/d‘l>(?/)  + {t  - .1- )<!>'-'(  1 - .X-)  ^ dx 


0 
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+ Q' 


t — x 


y(l4>(y)  + (t-  x)^^t  - x) 


L.^q 

t 


x=t 


a / ni{x)[(t  - x)  - (t 
•"u 

a / /7i(:r)<l>‘'^(  / — x)dx 
•^0 


x)]d^(t  — x)  + a / $‘^(/  — o;)}f/a: 

•^0 


(5.68) 


Not  surprisingly,  the  same  result  could  have  been  obtained  had  we  considered  an  extended 
compound  renewal  process  with  response  function: 


Y(t)  = r'{T,S)  = -^r(T,S)  = 

dr 


a for  0 < r < .S' 
0 for  S < T < oc 


(5.69) 


Then,  the  revenue  rate  at  time  / is 


r{  t)  = / m(  X )E[r'(  t - x,  S )]dx 


•^0 


a'm(.T)[l  - $(  / - x)]dx 


•^0 


t 


= a I m(x)<^^{t  — x)dx 
•"0 


(5.70) 


Provided  that  E[.S']  exists,  we  obtain 


a 


'X' 


a E 


r = lim  f{i)  = — I <l>‘^{x)dx  = 

X.  /(  ,/o  /( 


(5.71) 


Similarly,  when  the  revenue  function  loi'  one  phone  call  is  in  general  R{t),  it  can  be  shown 


that 


r(  t)  = I ni(  X )<f>'^(  / - X )dR{  t - x ) 

■R) 


(5.72) 


and 


1 


X' 


V - lim  /-•(/)  = - / ^^'^{x)dR[x) 


(5.73) 


5.6  The  Extended  Compound  Renewal  Process  as  a Special  Case  of  the  Extended 

Compound  Point  Process 


In  order  to  derive  the  integral  e(iuation  for  the  characteristic  function  of  the  extended 


compound  renewal  process  we  had  to  assume  that  the  behavior  of  the  /77.-th  response  process 
depends  only  on  the  diffcreiire  of  the  current  obsei  vation  time  and  the  waiting  time  of  the 
777-th  renewal.  We  would  like  to  be  able,  however,  to  allow  the  response  process  to  have  a 
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more  general  form.  VVe  generalize  the  concept  of  extended  compound  renewal  process  by 
introducing  the  notion  of  extended  compound  point  process.  In  this  generalized  process,  we 
associate  with  the  i-th  event  occurence  of  the  process  {7V(/),/  > 0}  a stochastic  process 

characterized  by  the  following: 

1.  the  time  origin  of  Yi(t,  Wi)  is  the  epoch  of  occurence  of  the  i-t\\  event  Wi; 

2.  the  initial  condition  of  !}(/,  Wi)  is  Yi(Wi^Wi)  = ib/  ^ random  variable; 

3.  the  random  variables  Iq^’s  are  indepeudently  and  identically  distributed  conditional 
on  the  waiting  times  11/ ; 

4.  the  stochastic  processes  {V/(/,  II/),/  > II/,  i = 1,2,...}  are  independently  and  iden- 
tically distributed  conditional  on  the  waiting  times  It/. 

The  extended  compound  point  process  {X(t),t  > 0}  is  then  defined  as 

N{t) 

A'(/)  = EVni/JUn) 

m=  1 

= V}(/,  tIV)  + Y-2(t,  it/)  + . . . + VW(o(^  (5.74) 


In  what  follows,  we  shall  derive  ex])ressions  for  E[.Y(/)]  and  Var[.V(/)]  for  the  extended 
compound  point  process  .V(/)  in  terms  of  the  first  two  moments  of  N(t)  and  Y(t,Wi).  We 
also  obtain  an  expression  for  the  higher  order  moments. 

Next  we  shall  apply  the  results  to  the  P / G f oo  (PP— point  process)  queue  and  show 
how  one  can  derive  expressions  for  the  expected  numbei*  of  busy  channels  and  its  variance. 
We  shall  show  that  the  PP^^  queue  generalizes  existing  results  for  the  M(ty^ /G joe 

and  the  Gl^  /G/oc  queues.  Again  we  should  note  here  that  deriving  results  for  the  dis- 
tribution  of  the  number  o(  busy  channels  is  not  ])ossible  lor  the  PP^  /G/oo  queue  unless 
one  makes  additional  assumptions  concerning  the  underlying  point  process  > 0}, 

such  as  characterizing  the  properties  of  its  inter- arrival  times.  Two  additional  examples 
related  to  the  PP/G /oc  (pieue  are  also  provided  which  include  the  derivation  of  the  first 
two  moments  ol  the  total  l)acklog  and  of  the  total  revenues  from  telephone  traffic.  Finally, 
we  provide  an  example  in  which  we  deteniiine  the  expectation  and  the  variance  of  the  ex- 
tended compound  point  j)rocess  foi*  spe(‘ific  forms  of  empirical  functions  for  the  expectation 
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and  the  covariance  of  the  underlying  point  process.  The  forms  of  these  functions  are  in 
contrast  to  the  ones  generated  by  a renewal  or  a non-homogeneous  Poisson  process:  they 
model  situations  not  amenable  to  treatment  by  any  of  these  two  processes. 

Our  motivation  to  study  the  extended  compound  point  process  is  the  fact  that  very 
often,  it  is  possible  to  provide  for  a general  process  such  as  {N{t)^t  > 0}  its  first  two 
moments.  From  a practical  standpoint,  measuring  for  example  E[A^(0],  Var[iV(/)]  and 
Cov[7V(/i),  A^(/2)]  through  observational  data  does  not  appear  to  be  too  difficult  a task, 
even  without  relying  on  specific  assumptions  concerning  the  inter-arrival  times.  Thus,  in 
a way,  it  is  appealing  to  rely  on  the  availability  of  the  second  order  moments  to  calculate 
corresponding  second  order  moments  of  the  process  {X(t)J  > 0}.  It  is  not  our  purpose 
here  to  elaborate  on  the  specific  statistical  tasks  of  measuring  the  first  two  moments  of 
{N{t)X  > 0}.  Rather,  we  may  assume  that  such  statistical  measures  are  available,  and 
proceed  towards  using  them  to  derive  expressions  for  E[.Y(/)]  and  Var[.Y(/)]. 

5.7  Notations  and  Dasic  Relations 
In  what  follows,  we  intioduce  the  indicating  function: 


0<14y</<oo 
0 otherwise 


(5.75) 


where  without  loss  of  generality  the  subscript  i is  dropped  from  Yi(t^Wi).  We  also  use  the 
concept  of  double  Stieltjes  integral  defined  as  follows 

Let  ^{x^y)  and  be  two  right  continuous  real- valued  functions  of  (x^y)  G R^. 

Then 


t /•  t 


0 ‘"O 

t rt 


i[x,y)dly<\'>{x,y)  = 


r t Q 

. f/y 


t Q 

+ E / - 4>(,r,yf]  dx 


y,eS 


0 


dx 


y 


+ E E ijj  ) + 4>(x;  , ) 

(I’l.J/j  )eSxy 


(5.76) 
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where  Sx,Sy,Sxy  are  the  sets  oi  points  of  nondifFerentiability  of  $(,r,y)  with  respect  to  x, 
y and  {x,y)  respectively. 

We  also  recall  that 


1. 


= Pr{A^(.f  ) > m] 


(5.77) 


2. 


CO 


L[iV(.r)]  = ^ inPr{N(x)  = 7??-} 


771=1 

'CO 


'CO 


^ Pr{A'(.r)  >m}=J2 


(5.78) 


771=  1 


771=  1 


3.  Similarly 


CC'  cc* 


E[iV(:l*i  ) . . . N(Xr  )]  = 


E • • • E */V(.X-r)  > Ik} 

h = l /t  = l 


'CO  lyZ) 


i:...EPr{Hh  < xi,. . .,Wi^  < Xk]  (5.79) 

/,  = i u-=i 


In  particular  for  x < y 


CC>  'CO 


E[N(x)N{y)]  Pr{^'(-^-)  > m,N(y)  > k} 

771  = 1 k=l 


CO  CC' 


= E LP*lHm<,r,H,  <J/} 


771=1  k=\ 
'CO  771 


= E E P'  {''  'n  < X,  If  , < y} 


771  = 1 A—1 
'CO  'CO 


+ E E PiiHm<x-,in.<y} 

777  = 1 A;  = 777-f-l 


Also,  for  k < m 


Pr{Hm  < x,Wk  < y}  = Pr{H;,  < x} 


which  depends  only  on  x.  Tlierefore  (5.80)  can  be  written 


CO  771 


'CO  <co 


E[fV(.r)A^(:i/)]  = E E 'Pm  < + E E lP-{'Pm  < X,  hPfc  < y} 

m=i  k=\  m-1  k=m+i 


(5.80) 


(5.81) 
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5.8  The  Expectation  of  the  Extended  Compound  Point  Process 
The  expectation  of  the  extended  coini)onnd  point  process  is 


E[A'(/)]  = E 


N(t) 

771  = 1 


= E 


CO 


E Ht,Wm) 


*"771  = 1 


CC' 


= EE[/(/,H'm)] 


m=l 


oc> 


oc» 


= E/  ni{t,Wrn)\Wrn  = x]dPr{Wrn<x] 


m=I  0 


OC- 


CO 


= E / E[/(Ea’)](/  Pr{lE„,  < .t} 


771=1  ^ 


Assuming  absolute  convergence,  the  order  of  integration  and  summation  may  be  inter- 
changed so  that 


E[X ( / )]  = / E[ / ( / , ,r )] (/  E E r { 14  „ < ;r } 


u 


m = 1 


E[y(/,  ,X‘)]r/E[7V(.7; )] 


0 


(5.82) 


Alternatively,  this  result  could  have  been  obtained  by  conditioning  on  N(t).  However,  the 
above  derivation  is  considerably  simpler. 

5.9  The  Second  Moment  and  the  Variance  of  the  Extended  ConiDound  Point  Process 
The  second  moment  ol  the  extended  compound  point  process  is 


nx\t)]  = E 


\(m  \'l 

' E E(  M4  nx)j  j 


\7?1  = 1 


(5.83) 


or 


CO 


2 


J 


E[-V'(/)]  = E I ( E /(El'm) 

7/1=1 

'X.’  '>:■  ''yj 

E/'(EHm)  + 2E  E IU.^y,n)l(t.\'Vk) 

m = l k=m-\-[ 


= H 


7/1=  J 


cc> 


= E E[/'^(/.ll„J] 


7/1=  1 
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'>0  'X- 


m = l Ar=7/i  -f-l 


X 


X 


^ / E[/''(/,.x-)]r/Pi{l4';„  <a-} 


X X 

+^E  E 

771=1  k=ni-\-l 


Since  for  y < x and  k > m + 1 


E[I(t,x)]E[I{t,y)]dly?r{Wm  < x,Wk  < y}  (5.84) 


Pr{14;„  < ,r,  14)t  < y)  = Pi{l4  fc  < y} 


which  depends  only  on  y,  we  have  for  y G [0,,t) 


dly  Pr{l4  m < X,  VPfc  < 2/}  = 0 


(5.85) 


Thus,  relation  (5.84)  can  be  written 


X 


X 


/ E[/^(/,.r)]rfPr{i4;„  < ,i;} 


m=l 


+'^E  E 


771  = 1 k='in-\-[ 
X) 


E[I(t.,x)]E[I{t,y)]dlyPv{W.m  < xJVi,  < y} 


0 


E[/'(/.,x)]f/X^  Pr{lE™  < x} 


771  = 1 


+2 


X X- 


E[J{t,x)]E[J(Uy)]dly  Y.  E < .X-,  W,  < y}  (5.86) 


771=1  A-  = 771  + 1 


Note  that 


Pi{lEm  < .r.  Hi.  < y}  = Pr{iV(x)  > m.  N(y)  > k} 


is  true  only  when  simultaneous  arrivals  cannot  occur,  i.e. 


Pi‘{il  r?i  < X,  H T-  < .t}  = Pr{lF/,^  ^ = lim  Pr{IT„^  < x^W^  < y} 


y-^x- 


Also,  using  (5.80) 


X'  X 


dlyE[N(x)i 


= ^'ryY  E ‘"•■{H'm  < .r,l4'x.  < 2/} 

771=1  A:  = 771-1-1 


(5.87) 


X 771 


'-'xy 


Pr{HTi  < x}  = 0 


771=1  A:=l 


because 
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Thus,  using  property  (5.78)  and  relation  (5.87),  (5.86)  can  be  written 


E[X2(i)]=  / E[Y\t.x)]dE[N(x)]  + 2 f I ' E[Y(t,x)]E[Y(U  y)]dl^E[N{x)N{y)]  (5.88) 


Moreover, 


E\X{t)]  = 


t X 2 

E[y(/,a‘)]r/E[7V(a;)] 

0 

/ / E[Y{t,x)]E[Y{Uy)]dE[N{y^^^^ 

•^0  '^0 
t r X 

E[r(/,aO]E[y(/,^)]r/E[y(y)]./E[A^(aO] 

0 -"0 

+ 11  E[y(/.,.iA]E[y(/,,^)]r/E[A^(^)]r/E[iV(a*)] 

t rt 

E[y(/,a;)]E[y(/,y)]r/E[A^(^)]r/E[^^^ 

•^0  ■' y 

+ / E[y(/,aA]E[y(/,;^)]r/E[A^(?y)]r/E[A^^ 


(5.89) 


Since  the  integrand  in  the  second  part  of  (5.89)  is  a symmetric  function  of  x and  y^  (5.89) 
can  be  written 


E'^[.V(/)]  = 2 


E[T(/.,  .r)]E[r(^,  t/)]rfE[7V(y)]f/E[A' (.X-)] 


(5.90) 


Thus,  combining  (5.88)  and  (5.90)  we  obtain 


Var[.Y (t}]  = E[ A' '^( t )]  - E'^ [.V ( t )] 


0 


E[y2(/,.r)]f/E[.V(.r)]  + 2 / / E[r(/...r)]E[y(/,  y)]7>J, E[y(.r)vV(;!/)] 


-2  / / E[y(/,,r)]E[y(/.,,//)]^J,^(E[iV(i/)]E[iV(:r)]) 

•^0  X 


E[y'(/,x-)]f/E[iV(;r)] 


0 


+2  / / E[Y{t.x)]E[Y{t,y)]dly(E[N(x)N(y)]-E[N{y)]E[N(x^^^^ 

'^0  X 

[ E[y'(Ea:)]f/E[.y(.r)]  + 2 / / E[y(A  ;r)]E[y(E  ;(/)](>, ^T::ov[.y(,xA.  iV(  i/)]  (5.91) 

•^0  •>'u  X 


This  quasi-closed  form  result  shows  that  it  is  j)ossible  to  obtain  Var[A(/)]  in  terms  of  the 
first  two  moments  of  A''(/)  and  Y(t.x). 
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5.10  Higher  Monients  oi  the  Extended  Compound  Point  Process 


Similarly  we  can  obtain  the  r-th  moment  of  the  extended  compound  point  process  as 


follows 


E[X^(t)]  = E 


//V(i) 

\ '=1  / J 


VI 


= E 


'>C< 


<yz‘ 


oo 


l/i  = 1 lr  = l 

CO  /-CO 

E[/(<,a,-i) . . .I(t,Xr)]d^i...xr  Pr{ini  < a,'i, 


'yz> 


U 


U 


CO 


= E---E 

/i=i 

CO  '-yz' 

= E • • • E / ■I  i'X/( ^ 'i/, in,, )i IE/.  = ,fi , . . . , m. 

/:=!  ir=\  ^ 

^X]---Xr  E^‘{11 1 1 ^ .r  1 , . . . , H /^,  ^ .Cy. } 


< ^r} 


— '^r\ 


Assuming  absolute  convergence,  and  using  the  same  procedure  as  in  Section  5.4,  we  obtain 


E[A-'(^)]  = 


0 


0 


E[y'(E:ri) . . .Y{t,Xr)]dj:^...oorE[N(xi)  • • •.V(a;,,)] 


(5.92) 


We  can  recover  the  first  moment  immediatelly.  The  second  moment  and  the  variance  can 
also  be  recovered  alter  careful  siil)stitution  and  if  we  take  into  account  that  for  0 < s < t < 


oo 


( ’ov[ A' ( .s ) , A’ (t)]  = Var[ A ( .s )]  + Cov[ A ( .s ) , A ( / ) - A ( .s )] 

(see  Parzen[31]).  1 he  procedure,  however,  is  more  cumbersome  and,  thus,  we  preferred  the 
previous  way.  Specific  expressions  for  the  higher  moments  will  not  be  attempted  here. 

5.11  1 he  Expectation  and  the  Variance  of  the  Number  of  Busy  Channels  in  the 

ppX  !Q ! Queue 

Infinite  server  queues  have  been  used  to  model  a broad  variety  of  systems  ranging  from 
analyses  of  flows  of  poj)ulations  to  ecological  studies  of  animals  of  given  species  in  a variety 
of  habitats.  Historically,  the  first  infinite  server  queue  to  be  studied  was  the  Af/M/oo 
queue  and  its  natui'al  extension  M[t)lGjoo  —where  M[t)  stands  for  a non-homogeneous 
Poisson  process-  (see  Brown  and  Ross[5]).  Similar  systems  have  been  developed  for  batch 
arrival  processes  (e.g.  see  Keilson  and  Seidman[26]  and  Chatterjee  and  Mukherjee[6]).  Some 
lesults,  also,  exist  for  the  GI IGjoo  queue  (see  e.g.  Puri[33]  and  Wolff[42]).  Similar  results 
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exist  for  infinite  server  queues  with  batch  arrivals  (see  e.g.  Liu  et  al.[27]  and  Liu  and 
Templeton[28]).  For  classical  approaches  to  problems  related  to  queues  with  batch  arrivals 
the  reader  is  referred  to  Chaudhry  and  Templeton[7].  Here,  following  Kendall’s  notation, 
we  consider  the  P jG j oo  queueing  systems,  in  which  batch  arrivals  occur  as  an  arbitrary 
simple  point  process  (PP).  Service  times  are  assumed  to  be  mutually  independent  but  may 
depend  on  the  batch  arrival  time.  They  are  also  assumed  to  be  independent  of  other  arrival 
times  and  other  service  times.  The  size  of  the  batch  can,  likewise,  depend  on  its  arrival 
time  but  it  may  not  depend  on  other  batches. 

Formulas  (5.82)  and  (5.91)  can  be  used  to  derive  the  expectation  diwA  the  variance  ol  the 
3^  s 1^1  t li  e inhnite  server  PP^  /G / oo  queue  with  random  batch  arrivals. 

The  PP^ /G/oo  (pieiie  can  be  considered  as  a special  case  of  the  extended  compound  point 


process  in  which 


B 


where. 


1)  P is  a discrete  random  variable  that  represents  the  size  of  a batch. 

2)  Sj  is  a sequence  of  nonnegative  independently  and  identically  distributed  random  vari- 
ables, with  distribution  lunction  F(']x)  and  complementary  distribution  function  P^(-;a*), 
representing  the  service  time  of  the  j-th  unit  of  a,  batch  that  arrived  at  time  x.  In  what 
follows  we  assume  that  the  first  two  moments  of  the  service  times  are  finite. 

3)  /(•)  is  an  indicator  function  defined  as  follows 


/ ( Sj G - x)  = 


1 , 0 < / - < Sj 

0,  otherwise 


1 {t^x)  is  a simple  compound  process.  For  notational  simplicity,  let  for  a batch  arriving  at 


time  IT,-  = x 


E[B\W;  = :r]  = fM(x) 


and 


E[P(P-l)|llq  = :r]  = //.2(:r) 


Then 


E[Y(ta')]  - 


= x]E[I(Sj,  t - x)] 
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E[/i|lF,  = .t]  Pv{Sj  > t - x} 


.V. 


o:][l  — F{t  — x;  x)] 


fi[(x)F^(t  - x;  x) 


(5.93) 


Substituting  (5.93)  into  (5.82)  we  obtain 


E[.Y(/)]  = / i^ii(x)F'^(t  — x;  x)dE[N (x)] 

0 


(5.94) 


Note  that  for  E[A'(/)]  the  independence  assumption  of  the  sequence  of  Y(t,Wj)  is  not 
required.  Also,  since  we  assumed  that  service  times  are  mutually  independent,  the  number  of 
units  of  a batch  arriving  at  time  x that  aie  still  in  service  at  time  /,  (/  > :r),  conditional  on  the 
batch  size  B = n,  is  binomially  distributed  with  parameters  n and  p,  where  p — F^{t  — x;  x). 


Therefore, 


E[y^(/,  :r)|i?  = n]  = - l)p^  + np 


From  the  law  of  total  probability 


E[y''^( /,  .!• )]  = P^E[B{  B - 1 )| H' ■ = .r]  + pE[B\Wi  = x] 


— r.2 


= [ F‘''(  / - X : X )fp2  ( )+  fit  - X ; x )//.  i ( ,r ) 


(5.95) 


Thus,  (5.91)  becomes 


Var[ A (t)]^  I p^( X ) F^(  t - x ; :r  )dE[N { x 

•A) 

t /•  / 


//■2(.r)[F^(/  -2’;;r)]'^f/E[yV(,T)] 


+2  1 I Pi{x)F'^(t  - x\x)p]{y)F''(t  - y;y)dl  Cov[N(x),N(y)]  (5.96) 


We  consider  now  two  im])orlajil  s|)ecial  cases. 

Special  Case  E The  M{  t y^ /G/oc  Queue 

First,  for  point  processes  with  independent  increments  we  recover  the  M{t)-’^/G/oo 
queue.  Thus,  if  A(/)  is  the  arrival  rate,  w'e  ol)tain 


!■' [ -'  ( 0 ] = / Pi( .f ) F^ {t  - x;  X ) A ( X ) dx 

0 


(5.97) 


dl^Cov[N{x).  N{y)]  = OjyCov[N(x),  N(y)  - .V(x)]  + Var[iV(x)]  = 0 


Also 
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Thus 


Var[A'(0]  = 


' f*' 

l^i\{x)F"'(t  — x;  x)X[x)dx  + / j.i2{x)[F‘^(t  — x;  x)]^ X(x)dx 

0 ‘'O 

t 

[/ii(a;)  + f22(x)F^{t  — x;x)]F'^(t  — x;  x)X(x)dx 


0 


(5.98) 


Special  Case  2.  The  GF^ /Gjoo  Queue 

Next,  if  the  arrival  process  is  a renewal  counting  process  with  renewal  density  m(-),  then 
the  system  is  the  GF^ /Gjoo  queue.  In  this  case  we  recover  the  well  known  result  for  the 


expectation: 


E[A"(/)]  — / /.Li(x)F^(t  — x;  x)m(x)dx 

0 


(5.99) 


Using  a result  for  the  difrerential  form  of  E[A^(.r )iV(y)]  (see  Daley  and  Vere-Jones[10] ) an 
expression  for  the  variance  is  obtained  as 


Var[A  (/)]  — / f-i[(x)F^(t  - x:  x)m(x)dx  + / fi2(x)  [F"^(t  — x;  ;r  )]^  rn{x)dx 

•^0  -^0 

+2  / / fii{x)F^((  - x;  x)f.ii{y)F'^(t  - - x)  - m(y)]dydx  (5.100) 

0 'G' 

Although  some  results  for  the  number  of  busy  channels  of  the  GF^  /G/oo  cpieue  exist  in 
the  literature  (e.g.  see  Liu  et  al.[27]),  an  expression  for  the  variance  does  not  seem  to  have 
appeared  so  far.  Ihus,  expression  (5.100)  appears  to  be  a novel  one.  Moreover,  existing 
work  on  the  Gl^  jG/oo  lias  restricted  the  service  times  to  be  identically  distributed  over 
time,  while  our  model  allows  for  variation  of  the  service  time  distribution  over  time. 

Additionally,  assuming  that  //i(.r)  = //i,  F^(t  — x;  x)  — F^(t-x)^  and  mean  inter-arrival 
time  //,  we  can  recover  the  well-known  result  lor  the  steady  state  expected  number  of  busy 
channels  of  the  GF^ /G/oo  queue: 


iin  E[A'(/)] 


//iE[5] 


(5.101) 


5.12  Other  Applications 


5.12.1  The  Expectation  and  the  Variance  of  the  Total  Backlog  of  the  PPIG/oo  Queue 

The  total  backloyin  an  infinite  server  queue  is  the  total  remaining  service  time  still  to  be 
provided  to  the  units  currently  in  tlie  system.  Eor  a PP/G/oo  queue  in  which  arrivals  occur 
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as  an  arbitrary  simple  point  process  ( PP),  it  can  be  described  by  an  extended  compound 
point  process  -using  the  same  assum])tions  and  notations  as  previously-  in  which 


Y(t,x)  = 


.S'  - ( / - X ) for  0 < /.  - X < S 
0 for  .S'  < t — X < oc 


Thus 


and 


Therefore 


and 


/•  oo 

E[y(/,x)]=  / {y  - t + x)dyF{y;x) 

'^t-X 


/cc> 

(y  - t + xfdyF(y;x) 

L-X 


E:[.V(/)]=  / / {y  -t  + x)dyF(fj:x)dE[N(x)] 

‘'O  -U-x 


(5.102) 


Var[X(<)]  =11  ( i"  - 1 + xfOnjF{  w\x)dE[N(x)] 

'^0  '^t-x 

+2  / f ( I (a  - I + x)()uF(u;x)  (v  - t + y)dyF(v\x)  j df.yCov[N(x),  N(y)] 


Special  Case  1,  The  M(t)/G/oo  Queue 


(5.103) 


[y  ~ t-\-  x)dyF(y\ x)\[x)dx 


0 t—x 


(5.104) 


and 


Var[.V(/)] 


( w - I + X )^du,F(  te;  ,r  )A(  x )dx 


■'0  ■' t -j 


Special  Case  2.  The  G' I /G joe-  Queue 


(5.105) 


E\X 


( y — I + X )dyF(  y;  x )in(  x )dx 


U t — x 


(5.106) 


and 


Varf; 


t r 

( ir  — / + X lu;  X )rn(  x )dx 

U 'U-x 

r cc> 

{ u - I + x)duF{u:x)  / ( (!  - /,  + y)dyF{v;x) 

■^t-y 


m{x)[in{y  - x)  - in(y)]dydx 


(5.107) 
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Additionally  assuming  that  F'^(/  — x;x)  = F'^{t  — x)  and  mean  inter- arrival  time  u we  can 


obtain  the  result  for  the  steady  state  total  expected  backlog  of  the  GI IGjoo  queue: 


Fl 

lim  \<:[X(D]  = 


(5.108) 


5.12.2  The  Expectation  and  the  Variance  of  the  Total  Revenue  from  Long  Distance  Phone 
Calls 

The  revenue  from  a given  long  distance  phone  call  is,  usually,  a function  of  the  duration 
of  the  conversation.  Here  we  assume  that  for  a conversation  starting  at  time  x,  the  revenue 


from  that  phone  call  at  time  / is 


/•(/,  X,  S)  - 


(\[t  — x)  for  0 < / - X < S 
a . S'  foi*  S < t — X < OC' 


where  S is  a nonnegative  random  variable  w hich  represents  the  duration  of  a conversa- 
tion starting  at  time  .t,  with  distribution  function  F{-;  x)  and  complementary  distribution 
function  F^{-;x).  Then 


•yo 


r{l.x,  ij)dyF[ij\ x) 


0 


t—x 


■X- 


iFKi  /•’( ,!/;  ) + / O ( t - X )0y F[  y\  X ) 

’F-x 

t — x 


- a I yOy  F(  y:  x ) + a(  t - x )F"^(  t - x;  x) 
0 


and 


/'X 

r^{t,x,(j)dyF(y:x) 

0 


t-X 


[cnjYdyFiy,  x)  -|-  a^[i  - x^F^^it  - x;  x) 


2 TFC 


•^0 


(5.109) 


Assuming  that  the  ai’rival  pi'ocess  ol  long  distance  phone  calls  is  an  arbitrary  simple  point 

process,  then  the  total  revenue  A(/)  over  [0,/]  is  an  extended  compound  point  process  in 
which 

N{t) 

A'(f)  = X! 

./=i 

where  the  random  variable  Sj  i’ej)i‘esents  tlie  duration  of  the  j-t\\  conversation,  assumed 
independently  and  identically  distributed.  Thus,  the  total  exj)ected  revenue  at  time  t is 


E[A(/)]  = / E[r(/,.r..S')]dE[A(.r)] 

0 
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t ( rt—x 

a / yOyF(y;x)  + a(t  - x)P^(t  - x;x)\  dE[N(x)]  (5.110) 
0 ^ •^0 


and 


Var[A"(/)]  = 


t r rt—x  \ 

«■  I I J y^dyF(y,  X ) + {t-  x fF‘"(t  - x;  ,t)|  f/E[7V(ar)] 

+2/  / E[r(/,as5)]E[r(^2/,5p2  Cov[yV(a'),iV(2/)] 

•^0 


(5.111) 


In  general,  the  expected  revenue  will  grow  infinitelly  large  as  / ^ 00  and,  thus,  we  do 
not  investigate  the  limiting  case.  It  may  be  interesting,  however,  to  investigate  another 
measure,  the  revenue  rate  defined  as  follows 


f(/)  = ^E[X(i)] 


Assume  for  simplicity  that 


r/E[.'V(/)]  =:  m(t)dt 


Then 


d 

dt 


E[A'«)]  = 


^ ^ I cv  y ydyF{  y:  x ) + cv(  t - x )F^(  t - x;  x ) f/E[A(a: )] 


■'0 

+n 


I [ y0yF{y,  x)  + {t  - x)F^{t  - x;  x)  ) r/E[(x)] 


•^0 

t—X 

yOy F( y:x)  + (t  - x )F‘^( t - x\ x ) 


LJ  y 


m.(  t ) 


X = t 


a 


/ - *t*)  - (/•  - x)]dyF(t  - x;  x)  + a f ni(x)F^(t  - x;  x)dx 


t 

— a I in(x)F'^^t  - x;  x)dx 
u 


(5.112) 


Additionally  assuming  that  F^t  - x;x)  = F^(t  - x)  and  that  m.(t)  = l/v,  where 

u is  the  mean  inter-arrival  time,  we  can  recover  the  well-known  result  for  the  steady  state 


expected  revenue  rate: 


/•  = lim  /■(/-)  = — 


(5.113) 


5.12.3 A Special  Model:  Moments  of  the  Underlying  Point  Process  Determined  Empirically 

To  the  extent  that  one  is  only  interested  in  computing  the  first  two  moments  of  the 
extended  compound  point  |)iocess,  available  techniques  to  describe  the  two  moments  of  the 


underlying  point  process  fail  to  encompass  situations  which  are  not  amenable  to  modeling 
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as  a renewal  process  or  as  a non -homogeneous  Poisson  process.  VVe  provide  here  an  example 
that  demonstrates  the  utility  of  our  model  in  such  situations.  In  what  follows  we  assume 
that  we  have  enipirimlly  determined  the  time  dependent  forms  for  the  first  two  moments  of 
the  underlying  point  process  which  cannot  be  considered  as  generated  from  either  a renewal 
process  or  a non-homogeneous  Poisson  process. 

Let  us  assume  that  the  expectation  of  the  underlying  point  process  has  the  empirically 
determined  form: 

E[.¥(/)]  = u{  I - + b{t  + sh\u!i)  (5.114) 


where  > 0 and  / > 0.  This  form  guarantees  that  E[7V(0)]  = 0,  Moreover,  E[A^(^)] 

is  a non-decreasing  function  that  oscillates  asymptotically  about  the  line  a + bt  with  period 
27t/u;.  Clearly  then 


r/E[A' (/)]  = [ai3e  +/>(!+  uj  cos  ujt)]dt 


(5.115) 


A function  of  this  form  would  be  ina.p])ro{)iiate  to  descril)e  the  renewal  density  function 
of  a renewal  pi'ocess  since'  it  does  not  converge  as  i — oc.  It  would  be  appropriate  for  a 
non-homogeneous  l\)isson  pi*ocess.  However,  the  non-homogeneous  Poisson  process  requires 
that  the  covariance  ol  the  increments  be  zero.  To  demonstrate  the  generality  of  our  model 


we  can  assume  that  the  covariance  lunction  of  the  increments  is,  in  general,  nonzero,  say  of 
the  following  empirically  determined  form: 


Cov[iV(/)  - A' (^),  /V(^)]  = c(  1 - e ^^)(1  - e 


(5.116) 


where  7 > 0 and  0 < .s  < /.  Idiis  form  guarantees  that  for  .s  = /,  Cov[A' (/)- A(.s),  A^(6^)]  = 0 
and  again  that  for  ( / - .5)  -*  -oc,  Cov[A'(/)  - A' (.s),  A^(.^)]  = 0. 

We  obtain  then 


OxyCov[N(y)  - A' (,r ),  N(x)]  = dxyCo\[N (y),  N(x)] 

= (5.117) 


Substituting  (5.115)  and  (5.117)  into  (5.82)  and  (5.91),  we  obtain 


L[A  ( / )]  = / E[E(  X )][al3e  -|-  b{  1 + cos  ljx  )]d.r 


(5.118) 
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and 


Var[X(i)]  = / E[Y‘^(t,x)][al3e  b{l  + uj  cosLJx)]dx 

'^0 

+^2  f f E[Yit,x)]E[Y(t,y)]{4n\-^^^y-^'>  - -2n^e-^^^y-^'>)dydx{5.n9) 


Special  Case  1.  The  number  of  busy  channels  in  a PP/G/oo  queue 
For  example  consider  a PP/G/oo  queue  in  which  the  arrival  rate  of  the  customers 
is  time  dependent  and  is  dictated  by  expression  (5.115).  Assume  for  simplicity  that  the 
complementary  distribution  function  of  the  service  times  F^(t-x;x)  = F^{t-x).  Let  X{t) 
be  the  number  of  busy  channels.  Using  (5.115)  in  (5.94)  with  f^ii{x)  = 1,  we  have 

E[A(/  )]  ==  / F"'(  t — x)[al3e~^^  + b(  l + u;  cosc^.r  )]d.r 
■^0 

= al3  I F"'(t  — x)e~-^'^dx  + b I F"'(t  — x)dx  + buj  I F^(t  — x)  cosujxdx  (5.120) 

"'o  Jq 

Taking  the  limit  as  / — oo, 


lim  E[A  [t)]  = bE[S]  + bu  lim  / F^(t  — x)  cosuxdx 

+00  ►CO  J Q 


(5.121) 


which  is  a periodic  function  that  oscillates  about  the  constant  value  6E[5] 
Similarly, 


Var[A"(/)]  = / F"^(t  — x)][al3e  + b(  1 + cj cos Ljx)]dx 

t rt 

+2  / F^(t-  x)F^(t  - y)(4c-re-^'^^y-^^  - 07 )dydx(5.122) 


and,  taking  the  limit  as  / oo,  we  obtain 


lim  Var[A^(/)]  = 

t^oo 


6E[5]  + bij  lim  / F'^il  - x)  cos  ujxdx 

t — ► oc<  .> 


0 


t r t 


+ lim  2 

t-^oo 


0 X 


F^(t  - - y)(4c-re-^~<^y-^^  - - 2n^e-'*^^y-^'>  )dydx 


(5.123) 
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Special  Case  2.  The  number  of  busy  channels  in  a PP/M/oo  queue 
Assume  again  that  the  arrival  rate  is  time  dependent  and  is  dicteted  by  (5.115).  Further 
assume  that  the  service  times  are  negative  exponentially  distributed  with  parameter  /i,  so 
that 

F‘^(t  - x)  = (5.124) 

Substituting  (5.124)  into  (5.120)  and  (5.122),  we  obtain 

E[X(t)]  = — e~^*(l  - e"*")  + - (1  - e~^^  ) + — (/t  coscv’t  + sin  (5.125) 

/t  r j K j 

and 


Var[.Y(t)] 


+8c7 


\ I ^11 


d -e"'“)  + -(l  -c 

/' 


) + 


')UJ 


( i^L  COS  ui  -\-  uj  sin  ut  — jie  ) 


1 _ 


[(//,-  27 )(//,  + 27)  (//,-  27)(2//)_ 


— 2c7 


fp  + 

I _ 


2 


1 - 


- 7)(/'  + 7)  {T  - 7)(2/^) 


— 4c7 


-It 


e 


e 


. ( /'  - 27 )( /'  + ) ( /i  - 27 )( 2/7.  - 7 ) 


(5.126) 


Taking  the  limit  as  t — 0C‘  we  obtain 


lim  E[A'(/)]  = (-  lim  —r— — -{ucosut  +a>sinai/) 

//  t-^oo  -f 


(5.127) 


and 


lim  Var[A  (/)]  = - + lim  — 


+ 


8c 


8c7  ^ 


-(//  cosbv7  + u;  siiud/) 

2c^{^ 


+ 


2c7 


2 


( - 27  )(fi  + 27 ) ( //  - 27 )( 2/i ) ( M - 7 )( /‘  + 7 ) ' (/i  - 7 )(2/7) 

^ 1*  / J . \ 9 T 27 

= h lim  — r -(//.  cosa-7  + sinu;t  + C'7  — ^ ; 

//.  ' /7(/7  + 27)(a7  + 7) 


(5.128) 


Let 


t -1 
tan  — 


Then  the  periodic  terms  in  expressions  (5.125),  (5.126),  (5.127)  and  (5.128)  can  be  written 


as 


/O/ 


>/  fp  + 


[sin  0 cos  + cos  (j)  sin  cot]  — 


\/  fp  + 


sin((x;/  + </!>) 
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Therefore,  the  expectation  and  the  variance  ol  the  number  of  busy  channels  have  a difference 
of  phase  (f)  with  the  expectation  of  the  arrival  point  process,  which  is  the  input  to  our  system. 
Note  that  the  parameters  b,  c and  7 must  satisfy  the  condition 


+ C7'^ 


+ 27 


/t(/f  + 27)(/<  + 7) 


> 0 


for  all  /i  > 0 so  that  the  variance  does  not  take  negative  values. 


5.13  Conclusion 


In  this  chapter,  motivated  by  the  filtered  Poisson  process,  we  extended  the  renewal 
process  and  presented  the  notions  ol  the  filtered  renwal  process  and  the  extended  compound 
renewal  process.  VVe  derived  a second  type  Volterra  integral  equation  for  the  characteristic 
function  of  the  extended  compound  renewal  process  and  we  investigated  special  cases  in 
which  the  integral  e(| nation  can  be  solved.  From  the  same  integral  equation  we  derived  the 
first  moment  ol  the  extended  compound  renewal  process  and  recursive  relationship  for  the 
higher  order  moments.  We  demonstrated  how  one  can  use  the  extended  compound  renewal 
process  to  model  infinite  server  (jnenes  with  bulk  ai'rivals  and  obtain  results  for  measures 
like  the  number  ol  busy  clia.nnels,  the  ontj)nt  rate,  the  total  backlog  and  the  revenue  rate. 
W'e  carried  our  analysis  one  step  further  and  showed  that  similar  results  can  be  obtained  for 
a more  general  class  of  stochastic  process  the  extended  compound  point  process.  Finally,  we 
demonstated  how  the  extended  compound  point  process  can  be  utilized  to  model  queueing 
systems  with  arrivals  occuring  accoi'ding  to  a point  process  that  cannot  be  described  as 
either  a renewal  counting  process  or  a non-homogeneous  Poisson  process  (see  Gakis  and 
Sivazlian[16,  17]). 


CHAPTER  6 

APPLICATIONS  AND  EXTENSIONS  FOR  FUTURE  RESEARCH 


6.1  Introduction 

In  this  chapter  we  present  some  ideas  that  we  feel  form  the  basis  for  applications  of  the 
results  obtained  in  this  work  and  extensions  for  future  research. 

6.2  A Continuous  Review  Inventory  Model 

6.2.1  Description  of  the  Policy  and  Notation 


We  consider  an  (s,S)  continuous  review  inventory  problem  with  constant  positive  lead 
time.  The  inventory  rej)lenishment  policy  is  thus:  whenever  the  inventory  level  falls  below 
6 > 0,  a quantity  is  ordered  to  bring  the  inventory  level  to  a positive  value  S > s.  In 
general,  the  quantity  ordered  is  not  constant  and  is  dictated  by  the  demand  pattern.  It  is 
always  greater  than  S — .s.  The  order  is  replenished  after  / time  units. 

The  demand  for  the  product  has  the  following  structure.  The  time  intervals  between  cus- 
tomer arrivals  triggering  withdrwals  from  inventory  form  a sequence  of  continuous  random 
variables  {!/}  with  known  finite  expectation  E[T].  The  amount  of  withdrawal  from  inven- 
tory to  satisfy  for  each  customer's  demand  form  a sequence  of  continuous  random  variables 
{Ti}  with  known  finite  expectation  E[r].  If  the  {Li}’s  are  identically  and  independently 
distributed  they  fonii  an  ordinary  renewal  process.  Similarly,  the  {C}’s  are  identically 
and  independently  distributed.  Likewise,  the  {2’z}’s  are  independently  distributed  from  the 
{l^l’s.  Any  unsatisfied  orders  are  backlogged. 

Our  objective  is  to  describe  an  approach  to  the  problem  that  will  lead  to  the  determina- 
tion of  the  average  time  interval  elapsed  between  two  successive  replenishment  orders  and 
the  average  stock  and  backlog  levels. 

We  shall  use  these  three  statistics  to  formnlate  an  expected  cost  function  per  unit  time, 

|)resse(l  in  terms  of  the  decision  variables  .s  and  S. 
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Figure  (i.l.  A coiitinuous  review  inventory  model 


6.2.2  The  Model 


Consider  a cycle  between  two  successive  order  replenishments  (see  Figure  6.1).  Let 


N{x)  = the  number  of  customers  which  have  arrived  from  the  beginning  of  a cycle 
when  a total  of  .7*  units  of  demand  have  been  generated, 


• N^(t)  — the  number  of  customers  which  have  arrived  from  the  beginning  of  a cycle 
when  a.  total  of  t units  of  time  have  been  elapsed, 

• Mt[x)  — E[N(x)], 

• mT(x)  = 


X — the  cycle  length, 


the  time  elapsed  (rom  t he  begin iiing  of  a cycle  till  an  order  is  placed. 
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Figure  6.2.  Realizalioiis  o(  t he  compound  renewal  process 


X+  = the  time  elapsed  from  the  moment  a order  was  placed  till  either  the  order  was 
replenished  or  the  stock  fell  below  zero, 


• A"  = the  time  ela))sed  from  the  moment  the  inventory  fell  below  zero  till  an  order 
was  replenished, 


V{x)  = the  forward  recurrence  "time”  of  the  counting  process  formed  by  the  sequence 
{>*}• 


Then 


V = A'""  + A'+  + A-  = A^^  + / 


(6.1) 


and 


A “ - Vi  + ) 2 + h yi\l(S-s-z)  + 


The  expectation  of  can  be  easily  determined. 
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Note  that  in  general  S - s - z may  take  negative  values,  i.e.  immediatelly  after  the 
replenishment  of  an  order  the  inventory  level  may  be  below  s.  In  this  case  we  assume  that 
an  order  is  placed  immediately. 

Note  that 

E[.V]  = E[X^]  + / (6.2) 

The  area  behind  the  inventory  curve  is  then 


A(5  - S - z)  — 1 1\  I + (Ti  + T2)Ys  + h (Ti  + T2  + — •Tyv(5_5_^))T7V(5_5_2)_j_i 


Since 


W\^Ti+T2  + ^“  + r,  for  7=1,2,. 


Then 


A{S  - s - z)  - H il  l + Ih'iia  + h M{S-s-z)^N{S-s-z)-hi 


Z{S  — s — z)  IS  a.  filtered  renewal  j)rocess  in  which  the  response  function  is 


and  it  is  easy  to  determine  its  ex])ectation. 

In  order  to  determine  tlie  lengths  A and  A'“  and  the  areas  B'^  and  B~  we  need 
to  study  more  closely  the  l)elia.vior  of  the  filtered  renewal  process.  The  following  general 
problem  relates  directly  to  our  problem: 

Given  a compound  renewal  process  A (/)• 


‘'MO  — 0 + / 2 + ‘ ^ ) 


and  two  barriers  one  on  the  /-axis  denoted  l)y  / and  one  on  the  A (/)-axis  denoted  by  c we 
want  to  find 


1.  = min[/,min{/  : X(t)  > c}] 


2.  E[X(A  + )] 


3.  B~^  [X~^  ) — 11  i^i  -f  1 12^2  + * • * + I ^ Y+ ) 
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4.  B (A  — 0 H A ■*"  — / or /i  ~ A^")V(c')4- [/ — y + )-i-i]TW(A''+)+i  + ~ 

lW)]?^iVO(/)  ifX+</. 

(see  Figure  6.2) 

In  the  context  of  our  inventory  model  c — S — s — F(.S'  — z — s). 

6.3  Infinite  Server  Queues  in  Tandem 

A natural  extension  of  the  infinite  server  queue  that  vve  have  considered  in  Chapter  5 is 
a system  of  several  infinite  server  queues  in  tandem. 

6.3.1  System  Description 

Consider  a service  syst  em  where  customers  are  served  through  a set  of  M ( M > 1 ) service 
stations.  Each  service  station  has  an  infinite  number  of  servers.  The  service  time  in  each 
station  is  a non-negative  random  variable  Si.  (?  = 1,2,...,  A/ ).  Arrivals  occur  according  to 
an  arbitrary  point  process  {N(t).  t > /}  (possibly  in  batches).  The  output  of  one  station  is 
the  input  to  the  subsequent  station.  Concerning  the  sequence  of  the  jobs  we  can  consider 
the  following  cases: 

• service  can  be  rendered  in  any  order;  in  this  case  we  can  investigate  the  problem  of 
optimal  sequencing; 

• service  has  to  be  rendered  in  a certain  order. 

Concerning  the  properties  of  service  time  distributions  we  may  consider  cases  such  as 

• service  times  are  mutually  independently  distributed  and  time  homogeneous; 

• service  times  depend  on  the  service  times  of  previous  stations; 

• service  time  distributions  are  time  dependent  or  non-homogeneous,  i.e.  depend  on  the 
time  service  is  rendered. 

6.3.2  Related  Problems 


Let  Xi(t),i  = 1,2, . . .,  M the  numl)er  of  busy  channels  of  station  i at  time  t.  Then 


A ( / ) — A 1 ( / ) + A 2(  / ) + • • • + A jY] ( / ) 
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is  the  total  number  of  busy  channels  in  the  system.  Likewise  let  be 

the  total  backlog  of  the  customers  currently  in  station  i at  time  t.  Then 

A (/)  = A](/)  + A2(^)  + • • • + ^m{^) 

is  the  total  backlog  of  the  system.  One  can  easily  identify  four  important  measures  of 
performance: 


• the  expected  number  of  busy  channels  in  station  i {i  = 1,2,...,  M)  E[A^i(^)]; 

• the  total  expected  number  of  busy  channels  E[A"(/)]; 

• the  total  exi)ected  backlog  of  station  i { i = 1,2, . . . , A/ ) E[Ai(/  )]; 

• the  total  expected  backlog  of  the  system  E[AA/)]. 


Likewise,  one  may  be  interested  in  determining  higher  order  moments  of  the  above  men- 
tioned random  variables  or  their  distributions.  For  the  case  of  mutually  independent  and 


time  homogeneous  service  times  preliminary  research  shows  that  tlie  total  number  of  busy 
channels  and  the  total  system  backlog  are  sequence  invariant.  When,  however,  service 
times  depend  on  the  sequence  or  are  time  non-homogeneous  the  investigation  of  optimal 
sequencing  properties  are  ap|)roj)riate. 


Joint  Characteristic  Functions 


We  have  already  discussed  the  methodologies  that  have  been  utilized  to  obtain  results 
in  renewal  theory.  One  of  the  methods  that  have  not  been  used  yet  is  that  of  working  via 
the  joint  characteristic  function  of  the  renewal  process,  i.e. 

I?r^.*S]  i ) + is'2 


Although  in  this  woi'k  we  have  oblained  all  tlie  information  contained  into  the  characteristic 
function  of  the  renewal  counting  process  its  investigation  may  provide  us  with  valuable 
insight  for  the  problem  ol  determination  of  the  joint  characteristic  function  of  the  extended 
compound  renewal  process  (see  discussion  in  Section  5.1)  which  presently  seems  a difficult 
task  to  handle. 
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6.5  Asymptotic  Normality  Properties 


The  existence  of  Central  Limit  Theorems  for  renewal  counting  processes  has  been  well- 
known.  Roginsky[34]  has  recently  worked  on  Central  Limit  Theorems  for  renewal  and 
cumulative  processes,  complemented  existing  results  and  improved  error  terms.  Now  that 
joint  distributions  ol  the  number  of  renewals  and  of  of  order  statistics  of  waiting  times  are 
available,  a natural  next  step  would  be  to  investigate  asymptotic  normality  properties  for 


them.  Specifically,  the  following  distributions  may  asymptotically  approach  normality  for 

integers  n\  < 112  and  real  numbers  0 < Li  < ^2  < t.3  < 00 

1. 


Pr{A'(/i)  = = n-i} 


as  both  ti  — 00  and  t-2  00 

2. 


Pr{iV(/2)  - iV(/l)  /?-i} 


as  ^2  — C — ' ^ 


Pr{.V(/2)-A'(/i)  = 7ii,A'(/3)-A'(/2)} 


as  both  t2  - t\  — oc  and  /a  - (2  —•  oc 


The  investigation  of  normality  properties  may  provide  useful  approximations  for  many  ap- 
plications. 


6.6  The  Concept  of  the  Parent  Distribution 

Definition.  In  this  section  we  investigate  the  problem  of  determining  the  distribution- 
from  now  on  referi'ed  to  as  the  parent  dzs^/'/tu/zo/i-and  the  corres|)onding  random  variable 
Z as  the  parent  randejin  variable-  that  generates  order  statistics  distributed  identically  to 
the  order  statistics  generated  by  the  waiting  times  ol  a j)oint  process.  But  first  we  derive 
a general  result  that  allows  us  to  determine  the  parent  distribution  (assumed  to  have  a 
probability  density  function)  from  an  arbitrary  distribution  of  order  statistics. 
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Lemma  1 Let  Fz(x)  denote  the  distribution  function  of  the  parent  distribution  to  be  de- 
termined. Let  Fyjx},i  = 1,2,...;?,  denote  the  known  marginal  distribution  functions  of  the 


order  statistics.  Then 


Fz(x) = 


E"=i  Fyj  x) 


11 


(6.3) 


Proof.  We  know  (see  Mood  et  al.[30]): 


fYilx) 


n\ 


-[Fz(x-)]‘-'[l  - Fz{x)f-^fz{x) 


(i  - l)!(  n - ■?■)! 


(6.4) 


If  we  sum  over  i we  have 


n 


n 


EfvM)  = 


n\ 


:-AFz{x)y-^[l  - Fzix)r-^fz(x) 


1=1 


1=1 
n — 1 

= n 


E 


(;•-  1 )!(;?-?)! 
(»-!)! 


- 1 -JA 


[Fz(x)y[i  - Fzix)]'^  ’ -'fzix) 


= n[Fz[x)  + 1 - Fz(x)]"  ^fz{x) 
= nfz(x) 


It  follows  immediately  for  x < t that 


fz{x)  = 


E"=i  fy,{x) 


n 


(6.5) 


and 


Fz{x)  = 


E”=i  Fy^x) 


n 


Using  (6.6)  for  the  order  statistics  of  a renewal  process  we  obtain  for  x < t 


(6.6) 


1 '' 

Pr{H'i  < 2‘|jV(/)  = n} 


n 

J_ 

n 

n 


1=1 

n 


Pr{iV (.t)  > /|iV(0  == 


1= 1 
n n 


Pr{A^(.T)  = j\N(t)  ==  n} 


1=1  j=i 
n j 


11 


E E Pr{jV(a:)  = il.'V(l)  = n} 


j=i  i=1 

n 


= -EjP>’i'^'(-^)  = il^'(0  = n} 

J = i 

_ E[iV(.r  )|7V(/)  = n] 


11 


(6.7) 
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and,  of  course,  for  x > /, 

Fz{x)  = 1 

An  intuitive  explanation  to  this  is  that  the  proportion  of  renewals  up  to  time  x given  the 
number  of  renewals  up  to  time  t > x in  an  infinitely  large  number  of  sample  realizations  of 
the  renewal  process  equals  the  proportion  of  observed  values  of  Z that  are  less  than  x in  an 
infinitelly  large  sample  of  observations. 

This  elaboration  and  explanation  have  been  based  on  an  implicit  assumption  that  the 
samples  that  generated  the  order  statistics  are  independent.  The  next  step  is  to  assume  that 
a variable  Z obeys  the  distribution  described  by  equation  (6.7)  and  recover  the  results  for 
the  order  statistics.  Should  this  approach  fail  to  yield  the  desired  results,  an  attempt  will 
be  made  to  investigate  the  converse  problem  under  the  broader  assumption  of  dependence 
of  the  samples. 


APPENDIX 


PROOF  OF  THEOREM  1 


Theorem  1 is  a special  case  of  the  following  theorem: 


Theorem  2 The  class  of  multiple  integrals  dehnecl  by 


• • • 


(j(ti  + t-2  + tn-s  )<Pl(h  )02(^2  ) * • * 0n(^n  )dti(lt2  * * * dtn 


0<ti-t-^2H 

where  for  / > 0,  g(t)  G C (i.e.  continuous)  and  4>i(t)  G K (i.e.  with  at  most  a finite  number 
ot  points  oi  discontinuity  in  every  finite  value  for  every  finite  interval  and  such  that  the 
integral  \(f)i{u)\du  has  a finite  value  for  every  / > Oj,  / ==  1, 2, . . . , ??,,  where  n is  a positive 
integer,  is  reducible  to  the  single  integral 


0 


{^/(  ^O[0l(  ^0  * d>2(u)  * • • • * </),,_5(a)]}  * (l)n-s-\-\{u)  * • • • (j)^{  u)du 


for  5 = 1, 2, . . . , 7Z  — 1 and 


•^0 


(j(u)[0\{u)  * 02(  ^0  * • • • * 0n(u)]du 


for  ^ = 0. 


Proof-  We  briefly  prove  the  Theorem  as  was  stated  in  Chapter  1 for  5 = 0.  Let 


In  = 


f(ll  + ^2  + • • * + )0l(  002(^2  ) * • ' (I>n(in)dtidt2  . . . dt 


n 


+^2H 


Also,  let 


A — /a  + ^4  + • • • + / 
109 


n 


no 


Then 


In  = 


<p3{h)4>4iU)  ■ ■ ■4>n{tn) 


^3  + ^4  


fih  + ^2  + )4^2(i2)(l-hdt2  . . ^dtn 


To  reduce 


I — I I /(^l  + /2  + )02(^2 


let  = r — a;  and  t2  — oj\  then 


t-\ 

1=1  f(T+X)l  (j)i(T  - Uj)(t)2(u;)dLjdT 
'h)  -^u 

t-\ 

f(r  + A)[0i(r)  * (p2(r)]dr 


Using  (6.9)  in  (6.8)  yields 


In  = 


(6.8) 


(6.9) 


03(73)  • • '(PnUn)  J f(r  + A)[0i(r)  He  02(r)]drd/3.  ,.dtn 
^ 

/('^  + ^3  + • • • + ^n)[0j(T ) * 02(^  )]03(^3)  * * •0n(Ui)drc//3  . . .dt^  (6.10) 

T + T3S 

Applying  the  previous  reduction  procedure  successively  to  this  last  integral,  vve  obtain  the 


final  result: 


In  = 


d>n(7')]dr 


•^0 


(6.11) 
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